-- Logs begin at Fri 2022-06-24 09:02:07 UTC, end at Fri 2022-06-24 10:26:05 UTC. -- Jun 24 09:52:20.249040 dv-cinder-843277-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 24 09:52:20.257888 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 24 09:52:20.259876 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 09:52:20 2022] *** Jun 24 09:52:20.259876 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 09:52:20.259876 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 09:52:20.259876 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: nodename: dv-cinder-843277-6-iscsi Jun 24 09:52:20.259876 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: machine: x86_64 Jun 24 09:52:20.259876 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: clock source: unix Jun 24 09:52:20.259876 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: pcre jit disabled Jun 24 09:52:20.259876 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: detected number of CPU cores: 4 Jun 24 09:52:20.260407 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: current working directory: / Jun 24 09:52:20.260407 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: detected binary path: /usr/bin/uwsgi-core Jun 24 09:52:20.260407 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: your processes number limit is 47680 Jun 24 09:52:20.260407 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: your memory page size is 4096 bytes Jun 24 09:52:20.260407 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: detected max file descriptor number: 2048 Jun 24 09:52:20.260407 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: lock engine: pthread robust mutexes Jun 24 09:52:20.260407 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: thunder lock: enabled Jun 24 09:52:20.261385 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 24 09:52:20.261486 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 09:52:20.304807 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: Python main interpreter initialized at 0x5582ad0539c0 Jun 24 09:52:20.304807 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: python threads support enabled Jun 24 09:52:20.304807 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: your server socket listen backlog is limited to 100 connections Jun 24 09:52:20.304807 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: your mercy for graceful operations on workers is 90 seconds Jun 24 09:52:20.305230 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 09:52:20.305230 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: *** Operational MODE: preforking *** Jun 24 09:52:20.305485 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: *** uWSGI is running in multiple interpreter mode *** Jun 24 09:52:20.305485 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: spawned uWSGI master process (pid: 110089) Jun 24 09:52:20.305693 dv-cinder-843277-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 24 09:52:20.311542 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: spawned uWSGI worker 1 (pid: 110090, cores: 1) Jun 24 09:52:20.311542 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: spawned uWSGI worker 2 (pid: 110091, cores: 1) Jun 24 09:52:20.311542 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 09:52:20.969703 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 09:52:20.977761 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 09:52:22.104381 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 09:52:22.104381 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: from cryptography.utils import int_from_bytes Jun 24 09:52:22.105030 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 09:52:22.105030 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: from cryptography.utils import int_from_bytes Jun 24 09:52:22.125339 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 09:52:22.125339 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: from cryptography.utils import int_from_bytes Jun 24 09:52:22.125923 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 09:52:22.125923 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: from cryptography.utils import int_from_bytes Jun 24 09:52:24.616658 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 09:52:24.623255 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 09:52:24.623255 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 09:52:24.623255 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 09:52:24.623255 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 09:52:24.623255 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.623673 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 09:52:24.624139 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.624235 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 09:52:24.624325 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.624410 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 09:52:24.624494 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.624494 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.624673 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 09:52:24.624673 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 09:52:24.625363 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.625439 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.625510 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.625510 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.625649 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.625720 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.625795 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.625866 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.625938 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.626019 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.626091 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.626162 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843277-6-iscsi {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.626236 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.626311 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.626387 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.626464 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.626583 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.626680 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.626761 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.626845 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.628655 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.628803 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.628931 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.629061 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.629184 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843277-6-iscsi {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.629316 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.629439 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.629566 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.629704 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.629704 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.629941 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.630075 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.630195 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.630322 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.630450 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.630578 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.630702 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.630834 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.631013 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.631013 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.631295 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.631464 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.631649 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.631783 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.631897 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.632024 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.632174 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.632300 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.632430 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.632559 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843277-6-iscsi {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.632687 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.632818 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.632952 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.633577 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.633674 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.633762 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.633853 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.633853 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.634059 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.634152 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.634238 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.634238 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.634440 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843277-6-iscsi {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.634528 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.634628 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.634715 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.634800 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.634879 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.634966 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.635161 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.635290 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.635362 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.635434 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.635575 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.635668 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.635759 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.635839 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.635962 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.636053 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.636171 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.636263 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.636355 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.636436 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.636519 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.636597 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.636680 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.636759 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.636837 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.636837 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.636996 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.637130 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.637213 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.637296 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.637383 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.637508 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.637602 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.637687 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.637778 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.637914 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.637998 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.638082 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.638162 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.638246 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.638330 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.638416 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.638502 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.638590 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.638668 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.638745 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.638830 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.638916 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.639000 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.639087 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.639171 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.639249 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.639340 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.639427 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.639515 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.639600 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.639678 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.639764 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.639896 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.639989 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.640068 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.640172 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.640305 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.640401 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.640487 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.640571 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.640695 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.640776 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.640863 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.641145 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.641239 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.641400 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.641487 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.641709 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.641795 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.642063 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.642254 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.642422 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.642566 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.642716 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.642879 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.643020 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.643187 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.643380 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.643503 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.643630 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.643766 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.643892 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.644010 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.644243 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.644375 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.644529 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.644773 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.644919 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.645050 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.645176 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.645304 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.645448 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.645588 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.645728 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.645853 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.645972 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.646108 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.646260 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.646392 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.646523 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.646711 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.646866 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.647036 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.647193 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.647338 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.647476 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.647610 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.647746 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.647879 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.648026 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.648231 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.648374 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.648523 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.648669 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.648811 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.648976 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.649115 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.649257 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.649393 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.649534 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.649678 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.649823 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.649969 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.650106 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.650248 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.650384 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.650537 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.650675 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.650847 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.650989 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.651156 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.651306 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.651453 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.651590 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.651755 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.651906 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.652161 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.652303 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.652457 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.652610 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.652754 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.652907 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.653051 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.653186 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.653364 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.653534 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.653672 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.653815 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.653951 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.654098 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.654244 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.654389 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.654534 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.654670 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.654816 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.654959 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.655108 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.655245 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.655379 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.655515 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.655697 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.656417 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.656572 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.656711 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.656847 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.656982 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.657128 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.657264 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.657443 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.657587 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.657766 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.657914 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.658060 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.658202 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.658362 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.658504 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.658647 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.658788 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.658936 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.659096 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.659257 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.659407 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.659567 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.659707 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.659875 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.660029 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.660200 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.660342 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.660501 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.660642 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.660808 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.660959 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.661107 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.661250 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.661393 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.661529 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.661708 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.661858 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.662034 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.662177 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.662377 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.662519 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.662671 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.662819 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.662984 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.663143 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.663287 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 09:52:24.663431 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.663609 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.663751 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.663933 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.664083 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.664265 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.664412 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.664564 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.664709 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.664845 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.664997 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.665159 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.665321 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.665459 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.665600 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.665786 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.665928 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.666101 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.666252 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.666417 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.666566 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.666732 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.666967 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.667125 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.667271 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.667421 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.667565 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.667701 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.667848 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.667985 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.668152 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.668295 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.668432 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.668613 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.668757 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.668958 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.669112 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.669256 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.669395 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.669584 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.669733 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.669911 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.670054 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.670226 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.670369 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.670538 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.670680 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.670846 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.671012 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.671156 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.671298 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.672176 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.672332 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.672488 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.672625 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.672784 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.672926 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.673100 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.673243 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.673413 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.673557 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.673706 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.674143 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.674283 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.674427 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.674572 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.674716 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.674910 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.675061 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.675226 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.675375 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.675539 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.675680 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.675851 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.676010 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.676175 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.676332 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.676471 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.676606 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.676789 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.676938 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.677101 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.677252 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.677390 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.677533 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.677695 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.677848 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.677992 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.678137 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.678274 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.678409 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.678581 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.678724 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.678901 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.679052 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.679226 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.679369 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.679513 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.679660 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.679847 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.680001 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.680211 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.680357 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.680494 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.680641 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.680791 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.680929 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.681065 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.681202 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.681337 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.681471 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.681651 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.681810 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.681947 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.682084 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.682249 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.682405 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.682569 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.682711 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.682879 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.683028 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.683173 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.683322 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.683488 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.683642 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.683790 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.683926 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.684083 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.684268 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.684407 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.684550 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.684720 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.684870 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.685031 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.685183 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.685343 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.685492 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.685650 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.685802 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.685970 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.686121 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.686260 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.686395 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.686568 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.686711 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.686889 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.687042 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.687261 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.687490 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.687645 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.687793 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.687940 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.688079 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.688249 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.688459 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.688603 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.688776 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.688935 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.689094 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.689238 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.689436 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.689580 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.689773 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.689935 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.690074 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.690210 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.690397 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.690548 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.690697 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.690834 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.691004 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.691147 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.691312 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.691455 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.691601 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.691738 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.691910 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.692060 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.692243 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.692380 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.692532 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.692670 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.692830 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.693064 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.693212 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.693358 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.693496 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.693632 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.693779 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.693915 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.694051 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.694194 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.694339 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.694482 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.694619 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.694756 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.694900 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.695112 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.695258 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.695402 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.695552 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.695701 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.695838 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.695982 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.696147 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.696302 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.696446 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.696589 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.696768 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.696919 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.697109 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.697252 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.697431 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.697572 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.697753 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.697897 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.698065 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.698207 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.698383 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.698524 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.698692 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.698841 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.699005 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.699146 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.699311 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.699452 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.699625 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.699777 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.699916 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.700060 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.700263 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.700402 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.700581 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.700732 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.700875 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.701015 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.701204 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.701356 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.701521 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.701663 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.701831 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.701981 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.702141 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.702295 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.702440 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.702581 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.702770 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.702912 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.703082 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.703235 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.703382 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.703519 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.703699 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.703848 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.703992 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.704165 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.704341 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.704484 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.704653 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.704807 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.704975 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.705119 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.705285 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.705436 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.705596 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.705746 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.705892 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.706028 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.706197 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.706340 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.706526 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.706668 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.706836 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.706978 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.707154 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.707296 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.707461 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.707609 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.707768 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.707905 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.708074 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.708310 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.708457 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.708593 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.708738 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.708883 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.709020 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.709155 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.709299 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.709449 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.709587 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.709733 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.709870 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.710005 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.710183 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.710335 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.710496 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.710638 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.710800 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.710943 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.711115 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.711288 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.711434 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.711572 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.711719 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.711855 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.711991 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.712161 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.712334 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.712496 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.712640 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.712783 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.712955 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.713105 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.713270 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.713418 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.713581 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.713725 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.713875 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.714018 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.714169 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.714312 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.714455 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.714605 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.714771 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.714915 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.715057 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.715199 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.715341 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.715492 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.715645 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.715788 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.715976 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.716186 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.716337 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.716491 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.716642 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.716786 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.716928 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.717071 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.717221 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.717373 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.717531 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.717681 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.717825 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.717973 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.718123 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.718275 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.718911 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.719055 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.719230 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.719379 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.719546 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.719703 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.719856 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.720010 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.720180 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.720328 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.720486 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.720631 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.720772 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.720922 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.721065 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.721207 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.721367 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.721520 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.721662 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.721805 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.721958 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.722100 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.722276 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.722426 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.722570 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.722711 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.722860 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.723012 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.723164 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.723307 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.723512 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.723752 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.723914 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.724179 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.724343 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.724495 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.724646 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.724789 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.724932 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.725088 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.725240 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.725384 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.725527 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.725668 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.725901 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.726076 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.726244 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.726401 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.726560 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.726713 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.726887 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.727044 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.727198 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.727347 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.727492 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.727633 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.727777 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.727939 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.728091 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.728265 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.728409 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.728561 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.728719 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.728875 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.729026 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.729178 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.729322 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.729465 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.729607 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.729758 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.729923 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.730076 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.730220 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.730363 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.730512 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.730655 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.730806 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.730949 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.731092 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.731234 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.731384 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.731531 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.731723 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.731895 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.732040 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.732241 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.732388 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.732542 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.732695 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.732839 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.732981 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.733131 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.733273 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.733415 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.733609 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.733757 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.733922 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.734108 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.734743 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.734895 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.735046 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.735191 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.735374 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.735531 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.735684 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.735841 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.736032 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.736201 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.736361 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.736520 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.736665 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.736827 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.736974 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.737117 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.737259 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.737409 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.737551 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.737704 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.737848 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.737991 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.738133 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.738286 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.738441 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.738585 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.738729 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.738871 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.739020 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.739171 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.739324 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.739468 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.739611 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.739754 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.739907 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.740057 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.740292 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.740439 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.740581 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.740723 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.740866 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.741007 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.741159 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.741302 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.741454 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.741597 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.741748 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.741901 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.742045 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.742199 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.742349 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.742492 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.742642 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.742794 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.742940 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.743082 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.743223 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.743372 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.743515 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.743666 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.743810 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.743953 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.744110 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.744291 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.744436 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.744587 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.744738 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.744881 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.745033 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.745176 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.745332 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.745475 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.745625 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.745777 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.745965 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.746114 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.746265 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.746409 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.746552 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.746694 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.746836 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.746978 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.747134 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.747277 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.747426 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.747569 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.747712 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.747869 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.748091 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.748261 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.748417 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.748560 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.748702 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.748853 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.748997 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.749140 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.749282 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.749423 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.749590 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.749748 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.749905 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.750059 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.750204 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.750355 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.750499 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.750651 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.750814 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.750814 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.751100 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.751241 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.751394 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.751546 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.751690 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.751850 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.752003 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.752189 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.752352 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.752497 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.752640 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.752782 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.753021 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.753215 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.753373 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.753519 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.753669 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.753812 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.753965 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.754120 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.754272 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.754416 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.754558 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.754699 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.754850 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.755001 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.755157 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.755302 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.755445 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.755596 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.755797 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.755955 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.756099 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.756265 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.756408 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.756552 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.756693 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.756846 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.756991 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.757133 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.757276 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.757418 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.757562 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.757723 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.757874 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.758018 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.758160 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.758304 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.758446 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.758597 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.758742 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.758895 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.759039 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.759181 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.759331 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.759483 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.759637 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.759782 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.759936 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.760081 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.760292 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.760438 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.760581 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.760724 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.760867 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.761017 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.761169 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.761324 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.761475 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.761629 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.761774 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.761916 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.762068 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.762211 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.762354 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.762497 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.762639 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.762781 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.762932 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.763076 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.763218 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.763370 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.763514 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.763669 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.763813 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.763955 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.764098 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.764286 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.764397 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.764498 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.764593 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.764686 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.764808 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.764935 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.765119 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.765266 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.765458 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.765617 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.765887 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.766044 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.766203 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.766354 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.766498 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.766640 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.766789 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.766932 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.767085 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.767241 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.767383 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.767526 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.767668 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.767817 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.767976 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.768203 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.768356 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.768514 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.768705 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.768857 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.769012 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.769158 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.769311 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.769454 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.769610 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.769762 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.769914 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.770057 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.770200 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.770342 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.770483 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.770642 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.770786 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.770936 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.771097 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.771249 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.771393 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.771544 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.771688 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.771830 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.771973 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.772150 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.772301 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.772457 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.772601 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.772744 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.773002 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.773169 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.773316 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.773467 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.773610 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.773759 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.773902 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.774044 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.774234 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.774384 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.774529 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.774671 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.774822 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.774964 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.775225 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.775375 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.775519 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.775667 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.775811 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.775953 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.776234 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.776384 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.776537 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.776688 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.776840 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.776992 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.777172 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.777326 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.777477 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.777622 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.777772 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.777923 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.778066 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.778208 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.778364 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.778510 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.778665 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.778816 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.778960 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.779124 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.779276 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.779419 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.779609 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.779760 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.779910 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.780066 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.780257 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.780403 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.780545 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.780727 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.781445 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.781606 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.781761 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.781904 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.782046 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.782193 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.782349 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.782494 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.782645 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.782790 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.782932 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.783082 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.783235 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.783378 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.783535 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.783689 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.783834 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.783976 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.784157 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.784320 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.784464 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.784614 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.784758 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.784901 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.785052 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.785203 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.785346 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.785498 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.785642 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.785792 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.785944 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.786088 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.786231 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.786373 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.786522 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.786742 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.786887 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.787030 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.787171 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.787313 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.787466 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.787618 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.787768 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.787919 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.788063 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.788252 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.788398 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.788550 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.788694 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.788837 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.788979 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.789123 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.789265 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.789429 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.789573 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.789716 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.789859 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.790001 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.790176 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.790327 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.790471 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.790612 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.790813 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.790971 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.791125 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.791270 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.791444 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.791595 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.791764 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.791914 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.792089 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.792306 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.792460 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.792611 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.792762 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.792918 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.793061 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.793204 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.793359 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.793508 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.793651 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.793801 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.793951 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.794094 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.794237 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.794379 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.794521 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.794671 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.794823 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.794965 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.795107 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.795259 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.795403 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.795559 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.795704 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.795847 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.796037 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.796208 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.796368 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.796566 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.797230 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.797332 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.797428 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.797623 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.797747 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.797966 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.798059 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.798292 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.798382 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.798601 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.798701 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.799192 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.799281 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.799507 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.799596 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.799815 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.799913 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.800142 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.800236 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.800453 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.800550 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.800785 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.800874 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.801091 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.801180 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.801406 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.801493 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.801721 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.801810 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.802036 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.802123 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.802359 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.802554 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.802717 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.802863 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.803007 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.803149 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.803292 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.803435 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.803587 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.803732 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.803884 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.804039 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.804279 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.804460 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.804621 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.804790 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.804942 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.805094 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.805239 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.805391 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.805535 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.805686 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.805834 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.806000 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.806160 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.806318 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.806463 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.806605 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.806906 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.807065 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.807211 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.807363 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.807507 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.807658 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.807827 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.807977 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.808172 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.808326 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.808482 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.808634 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.808803 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.808954 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.809106 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.809250 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.809418 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.809569 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.809734 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.809884 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.810049 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.810193 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.810376 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.810538 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.810688 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.810839 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.810991 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.811136 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.811286 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.811437 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.811588 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.811740 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.811894 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.812060 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.812235 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.812361 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.812545 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.812698 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.812842 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.813026 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.813180 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.813347 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.813510 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.813656 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.813817 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.813962 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.814104 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.814261 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.814406 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.814559 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.814711 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.814855 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.814998 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.815154 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.815299 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.815449 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.815609 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.815754 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.815897 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.816163 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.816317 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.816472 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.816695 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.816844 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.817012 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.817176 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.817321 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.817464 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.817652 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.817811 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.817964 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.818108 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.818278 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.818429 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.818573 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.818714 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.818901 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.819050 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.819201 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.819430 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.819580 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.819734 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.819887 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.820071 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.820245 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.820390 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.820542 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.820699 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.820851 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.820994 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.821137 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.821324 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.821474 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.821627 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.821789 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.821934 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.822077 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.822257 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.822406 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.822559 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.822760 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.822963 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.823108 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.823259 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.823410 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.823583 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.823729 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.823883 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.824027 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.824190 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.824351 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.824509 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.824661 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.824806 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.824948 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.825235 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.825392 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.825538 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.825687 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.825853 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.826004 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.826148 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.826300 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.826450 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.826611 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.826754 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.826897 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.827039 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.827197 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.827342 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.827484 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.827626 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.827810 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.827964 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.828108 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.828305 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.828449 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.828591 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.828733 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.828887 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.829039 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.829190 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.829334 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.829477 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.829618 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.829780 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.829926 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.830075 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.830220 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.830362 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.830512 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.830668 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.830821 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.830967 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.831111 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.831260 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.831412 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.831556 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.831751 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.831908 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.832061 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.832231 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.832387 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.832531 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.832673 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.832825 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.832968 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.833119 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.833276 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.833420 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.833573 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.833716 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.833867 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.834010 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.834162 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.834307 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.834449 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.834592 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.834743 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.834895 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.835039 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.835189 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.835339 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.835494 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.835637 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.835789 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.835933 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.836111 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.836301 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.836562 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.836710 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.836866 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.837010 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.837179 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.837329 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.837479 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.837639 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.837792 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.837936 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.838109 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.838266 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.838412 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.838564 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.838737 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.838893 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.839063 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.839212 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.839364 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.839606 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.839768 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.839948 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.840104 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.840300 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.840450 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.840605 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.840749 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.840913 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.841063 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.841207 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.841349 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.841505 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.841659 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.841802 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.841944 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.842108 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.842267 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.842413 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.842556 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.842698 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.842840 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.843008 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.843167 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.843822 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.843994 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.844193 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.844345 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.844511 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.844672 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.844817 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.844967 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.845111 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.845308 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.845540 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.845688 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.845831 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.845974 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.846136 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.846289 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.846441 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.846586 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.846730 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.846881 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.847031 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.847182 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.847338 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.847483 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.847629 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.847773 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.847925 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.848077 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.848256 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.848446 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.848605 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.848750 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.848901 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.849058 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.849210 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.849387 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.849537 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.849680 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.849821 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.849984 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.850128 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.850317 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.850477 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.850621 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.850777 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.850930 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.851072 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.851249 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.851397 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.851580 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.851739 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.851924 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.852075 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.852298 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.852442 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.852585 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.852737 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.852890 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.853040 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.853167 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.853268 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.853473 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.853568 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.853785 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.853875 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.854107 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.854198 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.854418 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.854509 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.854723 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.854821 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.855030 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.855120 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.855344 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.855445 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.855651 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.855737 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.855957 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.856043 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.856289 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.856382 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.856597 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.856710 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.856905 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.857002 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.857212 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.857381 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.857526 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.857668 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.857826 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.857977 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.858122 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.858265 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.858407 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.858548 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.858690 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.858841 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.859042 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.859690 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.859847 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.859995 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.860195 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.860369 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.860522 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.860666 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.860808 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.860950 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.861105 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.861248 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.861398 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.861540 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.861682 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.861823 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.861979 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.862140 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.862284 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.862427 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.862569 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.862710 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.862868 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.863020 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.863164 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.863314 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.863456 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.863598 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.863754 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.863904 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.864057 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.864233 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.864379 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.864531 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.864674 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.864816 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.864958 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.865100 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.865251 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.865403 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.865571 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.865722 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.865872 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.866025 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.866202 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.866361 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.866529 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.866751 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.866910 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.867055 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.867197 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.867349 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.867493 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.867642 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.867789 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.868039 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.868281 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.868430 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.868572 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.868715 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.868859 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.869001 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.869152 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.869319 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.869471 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.869653 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.869817 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.869996 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.870173 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.870364 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.870514 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.870698 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.870848 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.871001 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.871145 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.871326 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.871485 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.871630 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.871770 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.871956 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.872115 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.872297 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.872449 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.872656 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.872812 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.872966 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.873109 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.873281 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.873430 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.873602 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.873761 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.873905 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.874049 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.874252 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.874405 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.874572 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.874804 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.874952 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.875096 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.875245 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.875397 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.875548 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.875701 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.875844 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.876102 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.876307 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.876452 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110091) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 09:52:24.876612 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.876863 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.877216 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.877549 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.877869 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.878187 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.878497 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 09:52:24.878747 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110090) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 09:52:24.942636 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO dbcounter [None req-8e7ce0ba-c3be-4e49-aa2f-51fadc40e4c5 None None] Registered counter for database nova_api Jun 24 09:52:25.032204 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO dbcounter [None req-578d6e38-34f9-411d-8c6f-f64dd125e65b None None] Registered counter for database nova_api Jun 24 09:52:25.054059 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG oslo_db.sqlalchemy.engines [None req-578d6e38-34f9-411d-8c6f-f64dd125e65b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110091) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 09:52:25.057680 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG oslo_db.sqlalchemy.engines [None req-8e7ce0ba-c3be-4e49-aa2f-51fadc40e4c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110090) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 09:52:25.061498 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG dbcounter [-] [110091] Writer thread running {{(pid=110091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 09:52:25.064352 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG dbcounter [-] [110090] Writer thread running {{(pid=110090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 09:52:25.121906 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.context [None req-578d6e38-34f9-411d-8c6f-f64dd125e65b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fe31d9cf-df6b-4323-b574-c2625778abf9(cell1) {{(pid=110091) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 09:52:25.122507 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.context [None req-8e7ce0ba-c3be-4e49-aa2f-51fadc40e4c5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fe31d9cf-df6b-4323-b574-c2625778abf9(cell1) {{(pid=110090) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 09:52:25.126010 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG oslo_concurrency.lockutils [None req-578d6e38-34f9-411d-8c6f-f64dd125e65b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:25.126539 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG oslo_concurrency.lockutils [None req-8e7ce0ba-c3be-4e49-aa2f-51fadc40e4c5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:25.127586 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG oslo_concurrency.lockutils [None req-578d6e38-34f9-411d-8c6f-f64dd125e65b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:25.128177 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG oslo_concurrency.lockutils [None req-8e7ce0ba-c3be-4e49-aa2f-51fadc40e4c5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:25.128398 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG oslo_concurrency.lockutils [None req-578d6e38-34f9-411d-8c6f-f64dd125e65b None None] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:25.128992 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG oslo_concurrency.lockutils [None req-8e7ce0ba-c3be-4e49-aa2f-51fadc40e4c5 None None] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:52:25.130375 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG oslo_concurrency.lockutils [None req-578d6e38-34f9-411d-8c6f-f64dd125e65b None None] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:25.131073 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG oslo_concurrency.lockutils [None req-8e7ce0ba-c3be-4e49-aa2f-51fadc40e4c5 None None] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110090) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:52:25.132424 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO dbcounter [None req-578d6e38-34f9-411d-8c6f-f64dd125e65b None None] Registered counter for database nova_cell0 Jun 24 09:52:25.133079 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO dbcounter [None req-8e7ce0ba-c3be-4e49-aa2f-51fadc40e4c5 None None] Registered counter for database nova_cell0 Jun 24 09:52:25.136819 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO dbcounter [None req-578d6e38-34f9-411d-8c6f-f64dd125e65b None None] Registered counter for database nova_cell1 Jun 24 09:52:25.137010 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO dbcounter [None req-8e7ce0ba-c3be-4e49-aa2f-51fadc40e4c5 None None] Registered counter for database nova_cell1 Jun 24 09:52:25.145603 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG oslo_db.sqlalchemy.engines [None req-8e7ce0ba-c3be-4e49-aa2f-51fadc40e4c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110090) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 09:52:25.147243 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG oslo_db.sqlalchemy.engines [None req-578d6e38-34f9-411d-8c6f-f64dd125e65b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110091) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 09:52:25.149636 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG oslo_db.sqlalchemy.engines [None req-8e7ce0ba-c3be-4e49-aa2f-51fadc40e4c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110090) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 09:52:25.151199 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG oslo_db.sqlalchemy.engines [None req-578d6e38-34f9-411d-8c6f-f64dd125e65b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110091) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 09:52:25.151375 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG dbcounter [-] [110090] Writer thread running {{(pid=110090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 09:52:25.157676 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG dbcounter [-] [110091] Writer thread running {{(pid=110091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 09:52:25.160609 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG dbcounter [-] [110091] Writer thread running {{(pid=110091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 09:52:25.301691 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG dbcounter [-] [110090] Writer thread running {{(pid=110090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 09:52:25.308658 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO dbcounter [None req-578d6e38-34f9-411d-8c6f-f64dd125e65b None None] Registered counter for database nova_cell0 Jun 24 09:52:25.311578 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO dbcounter [None req-8e7ce0ba-c3be-4e49-aa2f-51fadc40e4c5 None None] Registered counter for database nova_cell0 Jun 24 09:52:25.318014 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG oslo_db.sqlalchemy.engines [None req-578d6e38-34f9-411d-8c6f-f64dd125e65b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110091) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 09:52:25.321488 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG oslo_db.sqlalchemy.engines [None req-8e7ce0ba-c3be-4e49-aa2f-51fadc40e4c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110090) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 09:52:25.322645 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG dbcounter [-] [110091] Writer thread running {{(pid=110091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 09:52:25.326008 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG dbcounter [-] [110090] Writer thread running {{(pid=110090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 09:52:25.753272 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: WARNING keystonemiddleware.auth_token [None req-578d6e38-34f9-411d-8c6f-f64dd125e65b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 09:52:25.760775 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: WARNING keystonemiddleware.auth_token [None req-578d6e38-34f9-411d-8c6f-f64dd125e65b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 09:52:25.845331 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: WARNING keystonemiddleware.auth_token [None req-8e7ce0ba-c3be-4e49-aa2f-51fadc40e4c5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 09:52:25.852786 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: WARNING keystonemiddleware.auth_token [None req-8e7ce0ba-c3be-4e49-aa2f-51fadc40e4c5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 09:52:26.101724 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: WARNING keystonemiddleware.auth_token [None req-578d6e38-34f9-411d-8c6f-f64dd125e65b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 09:52:26.108027 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: WARNING keystonemiddleware.auth_token [None req-578d6e38-34f9-411d-8c6f-f64dd125e65b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 09:52:26.114171 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5582ad0539c0 pid: 110091 (default app) Jun 24 09:52:26.116526 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-578d6e38-34f9-411d-8c6f-f64dd125e65b None None] Calling method '>' {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:52:26.117712 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-578d6e38-34f9-411d-8c6f-f64dd125e65b None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001953 Jun 24 09:52:26.118157 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Fri Jun 24 09:52:26 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:52:26.192877 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: WARNING keystonemiddleware.auth_token [None req-8e7ce0ba-c3be-4e49-aa2f-51fadc40e4c5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 09:52:26.199091 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: WARNING keystonemiddleware.auth_token [None req-8e7ce0ba-c3be-4e49-aa2f-51fadc40e4c5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 09:52:26.204410 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5582ad0539c0 pid: 110090 (default app) Jun 24 09:53:45.300733 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-578d6e38-34f9-411d-8c6f-f64dd125e65b None None] Calling method '>' {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:45.302469 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-578d6e38-34f9-411d-8c6f-f64dd125e65b None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002175 Jun 24 09:53:45.307834 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 930 bytes} [Fri Jun 24 09:53:45 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:53:45.321046 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG dbcounter [-] [110090] Writing DB stats nova_api:SELECT=3 {{(pid=110090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:45.322170 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG dbcounter [-] [110090] Writing DB stats nova_cell0:SELECT=3 {{(pid=110090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:45.323240 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG dbcounter [-] [110090] Writing DB stats nova_cell1:SELECT=3 {{(pid=110090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:45.324079 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG dbcounter [-] [110090] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:45.766801 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-e0c32bab-b16e-488e-9831-48f695923c48 admin admin] Calling method '>' {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:45.799422 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-e0c32bab-b16e-488e-9831-48f695923c48 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.483246 Jun 24 09:53:45.800187 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1291 bytes} [Fri Jun 24 09:53:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:53:47.919649 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-578d6e38-34f9-411d-8c6f-f64dd125e65b None None] Calling method '>' {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:47.921175 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-578d6e38-34f9-411d-8c6f-f64dd125e65b None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001926 Jun 24 09:53:47.921586 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 930 bytes} [Fri Jun 24 09:53:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:53:47.986860 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-781b5805-4354-42f0-aa69-6cdaff4ff14e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "os-flavor-access:is_public": true, "swap": 0, "ram": 256}} {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:53:48.005625 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:53:48.005625 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: warnings.warn(msg) Jun 24 09:53:48.123748 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-781b5805-4354-42f0-aa69-6cdaff4ff14e admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.195689 Jun 24 09:53:48.124761 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1282 bytes} [Fri Jun 24 09:53:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 09:53:48.139700 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG dbcounter [-] [110091] Writing DB stats nova_api:SELECT=3 {{(pid=110091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:48.147514 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG dbcounter [-] [110091] Writing DB stats nova_cell0:SELECT=3 {{(pid=110091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:48.147514 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG dbcounter [-] [110091] Writing DB stats nova_cell1:SELECT=3 {{(pid=110091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:48.147514 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG dbcounter [-] [110091] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:53:48.356308 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-8e93c1aa-96fb-46fa-83b1-a00d17b35074 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:53:48.358628 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:53:48.358628 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: warnings.warn(msg) Jun 24 09:53:48.503096 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-8e93c1aa-96fb-46fa-83b1-a00d17b35074 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.369710 Jun 24 09:53:48.503921 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1335 bytes} [Fri Jun 24 09:53:48 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:53:50.661045 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-781b5805-4354-42f0-aa69-6cdaff4ff14e admin admin] Calling method '>' {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:50.662062 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-781b5805-4354-42f0-aa69-6cdaff4ff14e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jun 24 09:53:50.662467 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 930 bytes} [Fri Jun 24 09:53:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:53:50.776082 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-950a9e33-6703-4ec9-9d98-978cf8124352 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds512M", "rxtx_factor": 1.0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "swap": 0, "id": "d1"}} {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:53:50.794103 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:53:50.794103 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: warnings.warn(msg) Jun 24 09:53:50.884534 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-950a9e33-6703-4ec9-9d98-978cf8124352 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.216082 Jun 24 09:53:50.885555 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1282 bytes} [Fri Jun 24 09:53:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 09:53:50.902136 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-9fa0a480-23b8-4151-ac1a-eb8e6d9e451c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:53:50.903886 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:53:50.903886 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: warnings.warn(msg) Jun 24 09:53:51.012750 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-9fa0a480-23b8-4151-ac1a-eb8e6d9e451c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115679 Jun 24 09:53:51.014005 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1335 bytes} [Fri Jun 24 09:53:50 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:53:53.180339 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-950a9e33-6703-4ec9-9d98-978cf8124352 admin admin] Calling method '>' {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:53.181351 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-950a9e33-6703-4ec9-9d98-978cf8124352 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jun 24 09:53:53.181744 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 930 bytes} [Fri Jun 24 09:53:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:53:53.244436 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-3627ff5e-87e2-45fe-aca0-1e474f0c7fda admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "id": "d2", "vcpus": 1, "disk": 10, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "ram": 1024}} {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:53:53.330575 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-3627ff5e-87e2-45fe-aca0-1e474f0c7fda admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.142206 Jun 24 09:53:53.331285 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1282 bytes} [Fri Jun 24 09:53:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 09:53:53.343850 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-b0252c64-af30-4400-9976-8239f41f2ccc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:53:53.443371 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-b0252c64-af30-4400-9976-8239f41f2ccc admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103140 Jun 24 09:53:53.451444 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1335 bytes} [Fri Jun 24 09:53:53 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:53:55.600608 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-3627ff5e-87e2-45fe-aca0-1e474f0c7fda admin admin] Calling method '>' {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:55.601648 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-3627ff5e-87e2-45fe-aca0-1e474f0c7fda admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Jun 24 09:53:55.602059 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 930 bytes} [Fri Jun 24 09:53:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:53:55.664677 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-937e800b-cccf-4a48-a4e9-4957cfeb421d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "disk": 10, "ram": 2048, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds2G", "id": "d3"}} {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:53:55.724014 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-937e800b-cccf-4a48-a4e9-4957cfeb421d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.116013 Jun 24 09:53:55.724676 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1282 bytes} [Fri Jun 24 09:53:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 09:53:55.736708 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-3529cc68-06c4-4a7e-a85a-417f2af31618 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:53:55.819257 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-3529cc68-06c4-4a7e-a85a-417f2af31618 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086183 Jun 24 09:53:55.819841 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1335 bytes} [Fri Jun 24 09:53:55 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:53:57.952566 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-937e800b-cccf-4a48-a4e9-4957cfeb421d admin admin] Calling method '>' {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:53:57.953596 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-937e800b-cccf-4a48-a4e9-4957cfeb421d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Jun 24 09:53:57.954295 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 930 bytes} [Fri Jun 24 09:53:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:53:58.043164 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-e66bbe67-28e5-42a5-9654-919ad3dfc7ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "disk": 20, "swap": 0, "id": "d4", "vcpus": 4, "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:53:58.120477 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-e66bbe67-28e5-42a5-9654-919ad3dfc7ae admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.154581 Jun 24 09:53:58.122304 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1282 bytes} [Fri Jun 24 09:53:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:53:58.135513 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-73ab3209-10b6-485a-acb6-547d41939ec6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:53:58.213278 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-73ab3209-10b6-485a-acb6-547d41939ec6 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082754 Jun 24 09:53:58.213967 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1335 bytes} [Fri Jun 24 09:53:58 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:54:00.318417 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-e66bbe67-28e5-42a5-9654-919ad3dfc7ae admin admin] Calling method '>' {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:54:00.320044 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-e66bbe67-28e5-42a5-9654-919ad3dfc7ae admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002048 Jun 24 09:54:00.320642 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 930 bytes} [Fri Jun 24 09:54:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:54:00.381968 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-a28979c9-8545-4451-be03-41ff95ce9e9e admin admin] Calling method '>' {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:54:00.408387 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-a28979c9-8545-4451-be03-41ff95ce9e9e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081277 Jun 24 09:54:00.408945 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1291 bytes} [Fri Jun 24 09:54:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:54:02.507095 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-e66bbe67-28e5-42a5-9654-919ad3dfc7ae admin admin] Calling method '>' {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:54:02.508534 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-e66bbe67-28e5-42a5-9654-919ad3dfc7ae admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001924 Jun 24 09:54:02.509052 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 930 bytes} [Fri Jun 24 09:54:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:54:02.578412 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-aa4dda21-33d5-4fb2-8b0c-5808216cfbc6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "1", "ram": 512, "disk": 1}} {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:54:02.661195 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-aa4dda21-33d5-4fb2-8b0c-5808216cfbc6 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.146036 Jun 24 09:54:02.661764 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1282 bytes} [Fri Jun 24 09:54:02 2022] POST /compute/v2.1/flavors => generated 402 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:54:02.675924 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-8f0f677f-2902-440d-ab76-415cb70b4b11 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:54:02.781968 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-8f0f677f-2902-440d-ab76-415cb70b4b11 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111113 Jun 24 09:54:02.782829 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1332 bytes} [Fri Jun 24 09:54:02 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:54:04.961343 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-aa4dda21-33d5-4fb2-8b0c-5808216cfbc6 admin admin] Calling method '>' {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:54:04.962372 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-aa4dda21-33d5-4fb2-8b0c-5808216cfbc6 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jun 24 09:54:04.962768 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 930 bytes} [Fri Jun 24 09:54:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:54:05.026280 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-5b09c34b-ae55-43af-aaad-38c906b2d1f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "vcpus": 1, "id": "2", "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:54:05.092377 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-5b09c34b-ae55-43af-aaad-38c906b2d1f4 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.123077 Jun 24 09:54:05.093286 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1282 bytes} [Fri Jun 24 09:54:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:54:05.105925 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-f1472c8a-779a-48a5-809d-abe61cad4ae6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:54:05.310235 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-f1472c8a-779a-48a5-809d-abe61cad4ae6 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.208467 Jun 24 09:54:05.311169 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1332 bytes} [Fri Jun 24 09:54:05 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:54:07.435837 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-5b09c34b-ae55-43af-aaad-38c906b2d1f4 admin admin] Calling method '>' {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:54:07.437682 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-5b09c34b-ae55-43af-aaad-38c906b2d1f4 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002301 Jun 24 09:54:07.438944 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 930 bytes} [Fri Jun 24 09:54:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:54:07.514666 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-c2ba4340-4d9e-4bb0-8a1b-089dfd7d382d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "rxtx_factor": 1.0, "disk": 40, "vcpus": 2, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:54:07.585888 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-c2ba4340-4d9e-4bb0-8a1b-089dfd7d382d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.141164 Jun 24 09:54:07.586466 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1282 bytes} [Fri Jun 24 09:54:07 2022] POST /compute/v2.1/flavors => generated 406 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:54:07.598655 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-926370b4-8920-43b9-a4ef-07f54fb5713d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:54:07.688007 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-926370b4-8920-43b9-a4ef-07f54fb5713d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093104 Jun 24 09:54:07.688633 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1332 bytes} [Fri Jun 24 09:54:07 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:54:09.770643 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-c2ba4340-4d9e-4bb0-8a1b-089dfd7d382d admin admin] Calling method '>' {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:54:09.771757 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-c2ba4340-4d9e-4bb0-8a1b-089dfd7d382d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jun 24 09:54:09.772342 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 930 bytes} [Fri Jun 24 09:54:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:54:09.830688 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-4f97d75b-9ce7-4b66-b059-5329b2031190 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "disk": 80, "swap": 0, "name": "m1.large", "id": "4", "os-flavor-access:is_public": true, "ram": 8192}} {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:54:09.900491 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-4f97d75b-9ce7-4b66-b059-5329b2031190 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.121672 Jun 24 09:54:09.908358 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1282 bytes} [Fri Jun 24 09:54:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 09:54:09.914607 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-8cb0d84c-9e01-4e48-be74-69ee1eb71159 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:54:09.996149 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-8cb0d84c-9e01-4e48-be74-69ee1eb71159 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085136 Jun 24 09:54:09.996757 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1332 bytes} [Fri Jun 24 09:54:09 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:54:12.110475 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-4f97d75b-9ce7-4b66-b059-5329b2031190 admin admin] Calling method '>' {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:54:12.111492 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-4f97d75b-9ce7-4b66-b059-5329b2031190 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jun 24 09:54:12.111884 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 930 bytes} [Fri Jun 24 09:54:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:54:12.186988 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-7549e2b3-02ee-4b33-8921-917dec621474 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "swap": 0, "ram": 16384, "rxtx_factor": 1.0, "vcpus": 8, "id": "5", "disk": 160}} {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:54:12.272405 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-7549e2b3-02ee-4b33-8921-917dec621474 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.152958 Jun 24 09:54:12.273376 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1282 bytes} [Fri Jun 24 09:54:12 2022] POST /compute/v2.1/flavors => generated 408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:54:12.285589 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-cb51ba83-e1e4-47c1-bfcf-a295d4407435 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:54:12.407187 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-cb51ba83-e1e4-47c1-bfcf-a295d4407435 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125116 Jun 24 09:54:12.407816 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1332 bytes} [Fri Jun 24 09:54:12 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 09:54:37.901791 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-7549e2b3-02ee-4b33-8921-917dec621474 admin admin] Calling method '>' {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:54:37.902731 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-7549e2b3-02ee-4b33-8921-917dec621474 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jun 24 09:54:37.903125 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 930 bytes} [Fri Jun 24 09:54:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:54:37.913658 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG dbcounter [-] [110090] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=110090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:37.961485 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-fc2759e0-c1fc-49f8-87e8-aa5e9eb4a253 admin admin] Calling method '>' {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:54:37.979764 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-fc2759e0-c1fc-49f8-87e8-aa5e9eb4a253 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070733 Jun 24 09:54:37.980330 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1291 bytes} [Fri Jun 24 09:54:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:54:38.887400 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-7549e2b3-02ee-4b33-8921-917dec621474 admin admin] Calling method '>' {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:54:38.888453 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-7549e2b3-02ee-4b33-8921-917dec621474 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jun 24 09:54:38.888852 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Jun 24 09:54:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:54:39.076447 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-fef56918-85d3-4c27-b803-2aea64d3f98d admin admin] Calling method '>' {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:54:39.082040 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.wsgi [None req-fef56918-85d3-4c27-b803-2aea64d3f98d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 24 09:54:39.085397 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-fef56918-85d3-4c27-b803-2aea64d3f98d admin admin] Request method failure captured: Jun 24 09:54:39.085397 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 24 09:54:39.085397 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: Accept: application/json Jun 24 09:54:39.085397 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: Accept-Encoding: gzip, deflate Jun 24 09:54:39.085397 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: Connection: keep-alive Jun 24 09:54:39.085397 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: Content-Length: 0 Jun 24 09:54:39.085397 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: Host: 10.222.0.26 Jun 24 09:54:39.085397 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: Openstack-Api-Version: compute 2.90 Jun 24 09:54:39.085397 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: Openstack-System-Scope: None Jun 24 09:54:39.085397 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: User-Agent: python-novaclient Jun 24 09:54:39.085397 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Auth-Token: gAAAAABitYnek73CBPUobuRjbn8vNOCvXoHtFzy89IPQ0iiFAV2BPwl7wYbLMbeggEYpysD6uVSlWpiiVT9EK4lBbcMhQAIfzKeIQAPqasY3QfNIUrLCJ7s2CH-gag5MonKQsmcZys8Ic8d1yQBMRJsk7yWji8gzK7GrVPL82jwRdXa32m8l6qk Jun 24 09:54:39.085397 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Domain-Id: None Jun 24 09:54:39.085397 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Domain-Name: None Jun 24 09:54:39.085397 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Identity-Status: Confirmed Jun 24 09:54:39.085397 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Is-Admin-Project: True Jun 24 09:54:39.085397 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 09:54:39.085397 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Project-Domain-Id: default Jun 24 09:54:39.085397 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Project-Domain-Name: Default Jun 24 09:54:39.085397 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Project-Id: 59b0d627f4684928bf39233a009e998d Jun 24 09:54:39.085397 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Project-Name: admin Jun 24 09:54:39.085397 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Role: reader,member,admin Jun 24 09:54:39.085397 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Roles: reader,member,admin Jun 24 09:54:39.087652 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/59b0d627f4684928bf39233a009e998d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_59b0d627f4684928bf39233a009e998d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/59b0d627f4684928bf39233a009e998d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/59b0d627f4684928bf39233a009e998d"}]}] Jun 24 09:54:39.087652 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Tenant: admin Jun 24 09:54:39.087652 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Tenant-Id: 59b0d627f4684928bf39233a009e998d Jun 24 09:54:39.087652 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Tenant-Name: admin Jun 24 09:54:39.087652 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-User: admin Jun 24 09:54:39.087652 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-User-Domain-Id: default Jun 24 09:54:39.087652 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-User-Domain-Name: Default Jun 24 09:54:39.087652 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-User-Id: 0f4a4bc5e7eb43169051c22471d3be4c Jun 24 09:54:39.087652 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-User-Name: admin Jun 24 09:54:39.087652 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: method: > Jun 24 09:54:39.087652 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: exception: Flavor 42 could not be found. Jun 24 09:54:39.087652 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: action_args: {'id': '42'} Jun 24 09:54:39.087652 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:54:39.087652 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:54:39.088793 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 09:54:39.088793 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 09:54:39.088793 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 09:54:39.088793 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 09:54:39.088793 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 09:54:39.088793 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 09:54:39.088793 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 09:54:39.088793 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 09:54:39.088793 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 09:54:39.088793 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:54:39.088793 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 09:54:39.088793 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 09:54:39.088793 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 24 09:54:39.088793 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi Jun 24 09:54:39.088793 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:54:39.088793 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi Jun 24 09:54:39.088793 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:54:39.088793 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:54:39.088793 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:54:39.090289 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:54:39.090289 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:54:39.090289 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:54:39.090289 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:54:39.090289 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 09:54:39.090289 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:54:39.090289 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 24 09:54:39.090289 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi Jun 24 09:54:39.090289 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:54:39.090289 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi Jun 24 09:54:39.090289 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:54:39.090289 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:54:39.090289 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:54:39.090289 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:54:39.090289 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:54:39.090289 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 24 09:54:39.090289 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi Jun 24 09:54:39.090289 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-fef56918-85d3-4c27-b803-2aea64d3f98d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:54:39.091581 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-fef56918-85d3-4c27-b803-2aea64d3f98d admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062452 Jun 24 09:54:39.091581 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Fri Jun 24 09:54:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 09:54:39.097080 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-a06f336e-3011-454a-a8c6-f822c3701b43 admin admin] Calling method '>' {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:54:39.100013 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG dbcounter [-] [110091] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:54:39.118375 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-a06f336e-3011-454a-a8c6-f822c3701b43 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024897 Jun 24 09:54:39.118903 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Fri Jun 24 09:54:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:54:39.128471 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-5b75c5f1-a3ce-4cd3-ac9b-0eca4bc79a35 admin admin] Calling method '>' {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:54:39.150566 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-5b75c5f1-a3ce-4cd3-ac9b-0eca4bc79a35 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025682 Jun 24 09:54:39.151090 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Fri Jun 24 09:54:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:54:39.160110 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-3c45fe1b-3a6e-45a4-ac40-39b9d0ebd8bb admin admin] Calling method '>' {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:54:39.166207 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.wsgi [None req-3c45fe1b-3a6e-45a4-ac40-39b9d0ebd8bb admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 24 09:54:39.169511 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-3c45fe1b-3a6e-45a4-ac40-39b9d0ebd8bb admin admin] Request method failure captured: Jun 24 09:54:39.169511 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 24 09:54:39.169511 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: Accept: application/json Jun 24 09:54:39.169511 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: Accept-Encoding: gzip, deflate Jun 24 09:54:39.169511 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: Connection: keep-alive Jun 24 09:54:39.169511 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: Content-Length: 0 Jun 24 09:54:39.169511 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: Host: 10.222.0.26 Jun 24 09:54:39.169511 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: Openstack-Api-Version: compute 2.90 Jun 24 09:54:39.169511 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: Openstack-System-Scope: None Jun 24 09:54:39.169511 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: User-Agent: python-novaclient Jun 24 09:54:39.169511 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Auth-Token: gAAAAABitYnek73CBPUobuRjbn8vNOCvXoHtFzy89IPQ0iiFAV2BPwl7wYbLMbeggEYpysD6uVSlWpiiVT9EK4lBbcMhQAIfzKeIQAPqasY3QfNIUrLCJ7s2CH-gag5MonKQsmcZys8Ic8d1yQBMRJsk7yWji8gzK7GrVPL82jwRdXa32m8l6qk Jun 24 09:54:39.169511 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Domain-Id: None Jun 24 09:54:39.169511 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Domain-Name: None Jun 24 09:54:39.169511 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Identity-Status: Confirmed Jun 24 09:54:39.169511 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Is-Admin-Project: True Jun 24 09:54:39.169511 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 09:54:39.169511 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Project-Domain-Id: default Jun 24 09:54:39.169511 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Project-Domain-Name: Default Jun 24 09:54:39.169511 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Project-Id: 59b0d627f4684928bf39233a009e998d Jun 24 09:54:39.169511 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Project-Name: admin Jun 24 09:54:39.169511 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Role: reader,member,admin Jun 24 09:54:39.169511 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Roles: reader,member,admin Jun 24 09:54:39.170984 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/59b0d627f4684928bf39233a009e998d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_59b0d627f4684928bf39233a009e998d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/59b0d627f4684928bf39233a009e998d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/59b0d627f4684928bf39233a009e998d"}]}] Jun 24 09:54:39.170984 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Tenant: admin Jun 24 09:54:39.170984 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Tenant-Id: 59b0d627f4684928bf39233a009e998d Jun 24 09:54:39.170984 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Tenant-Name: admin Jun 24 09:54:39.170984 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-User: admin Jun 24 09:54:39.170984 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-User-Domain-Id: default Jun 24 09:54:39.170984 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-User-Domain-Name: Default Jun 24 09:54:39.170984 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-User-Id: 0f4a4bc5e7eb43169051c22471d3be4c Jun 24 09:54:39.170984 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-User-Name: admin Jun 24 09:54:39.170984 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: method: > Jun 24 09:54:39.170984 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: exception: Flavor 42 could not be found. Jun 24 09:54:39.170984 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: action_args: {'id': '42'} Jun 24 09:54:39.170984 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:54:39.170984 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:54:39.171896 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 09:54:39.171896 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 09:54:39.171896 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 09:54:39.171896 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 09:54:39.171896 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 09:54:39.171896 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 09:54:39.171896 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 09:54:39.171896 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 09:54:39.171896 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 09:54:39.171896 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:54:39.171896 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 09:54:39.171896 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 09:54:39.171896 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 24 09:54:39.171896 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi Jun 24 09:54:39.171896 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:54:39.171896 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi Jun 24 09:54:39.171896 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:54:39.171896 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:54:39.171896 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:54:39.183616 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:54:39.183616 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:54:39.183616 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:54:39.183616 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:54:39.183616 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 09:54:39.183616 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:54:39.183616 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 24 09:54:39.183616 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi Jun 24 09:54:39.183616 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:54:39.183616 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi Jun 24 09:54:39.183616 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:54:39.183616 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:54:39.183616 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:54:39.183616 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:54:39.183616 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:54:39.183616 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 24 09:54:39.183616 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi Jun 24 09:54:39.183616 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-3c45fe1b-3a6e-45a4-ac40-39b9d0ebd8bb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:54:39.184915 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-3c45fe1b-3a6e-45a4-ac40-39b9d0ebd8bb admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014269 Jun 24 09:54:39.184915 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Fri Jun 24 09:54:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 09:54:39.982563 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-5b75c5f1-a3ce-4cd3-ac9b-0eca4bc79a35 admin admin] Calling method '>' {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:54:39.983608 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-5b75c5f1-a3ce-4cd3-ac9b-0eca4bc79a35 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jun 24 09:54:39.984013 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Jun 24 09:54:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:54:40.175084 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-be709d63-3208-49dd-8a2d-a940373aa158 admin admin] Calling method '>' {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:54:40.180408 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.wsgi [None req-be709d63-3208-49dd-8a2d-a940373aa158 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 24 09:54:40.182432 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-be709d63-3208-49dd-8a2d-a940373aa158 admin admin] Request method failure captured: Jun 24 09:54:40.182432 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 24 09:54:40.182432 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: Accept: application/json Jun 24 09:54:40.182432 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: Accept-Encoding: gzip, deflate Jun 24 09:54:40.182432 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: Connection: keep-alive Jun 24 09:54:40.182432 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: Content-Length: 0 Jun 24 09:54:40.182432 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: Host: 10.222.0.26 Jun 24 09:54:40.182432 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: Openstack-Api-Version: compute 2.90 Jun 24 09:54:40.182432 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: Openstack-System-Scope: None Jun 24 09:54:40.182432 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: User-Agent: python-novaclient Jun 24 09:54:40.182432 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Auth-Token: gAAAAABitYnfIfPBCG_Mq2EP3LoIRqI5kr0R-a0ax5uOqnQjqairXc0ORCMwND1q0X5-swWg0-MfRf8D3txTt-J9S20OF-3PPBDq2vGgfQrVQoFzdbqjpSCmKNwl1tmVATcAfVU8H7LaLft1FGpyNllFDXtifUKefWcpL3N2y1b6KOdtccnxW70 Jun 24 09:54:40.182432 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Domain-Id: None Jun 24 09:54:40.182432 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Domain-Name: None Jun 24 09:54:40.182432 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Identity-Status: Confirmed Jun 24 09:54:40.182432 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Is-Admin-Project: True Jun 24 09:54:40.182432 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 09:54:40.182432 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Project-Domain-Id: default Jun 24 09:54:40.182432 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Project-Domain-Name: Default Jun 24 09:54:40.182432 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Project-Id: 59b0d627f4684928bf39233a009e998d Jun 24 09:54:40.182432 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Project-Name: admin Jun 24 09:54:40.182432 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Role: reader,member,admin Jun 24 09:54:40.182432 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Roles: reader,member,admin Jun 24 09:54:40.184010 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/59b0d627f4684928bf39233a009e998d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_59b0d627f4684928bf39233a009e998d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/59b0d627f4684928bf39233a009e998d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/59b0d627f4684928bf39233a009e998d"}]}] Jun 24 09:54:40.184010 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Tenant: admin Jun 24 09:54:40.184010 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Tenant-Id: 59b0d627f4684928bf39233a009e998d Jun 24 09:54:40.184010 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Tenant-Name: admin Jun 24 09:54:40.184010 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-User: admin Jun 24 09:54:40.184010 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-User-Domain-Id: default Jun 24 09:54:40.184010 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-User-Domain-Name: Default Jun 24 09:54:40.184010 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-User-Id: 0f4a4bc5e7eb43169051c22471d3be4c Jun 24 09:54:40.184010 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-User-Name: admin Jun 24 09:54:40.184010 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: method: > Jun 24 09:54:40.184010 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: exception: Flavor 84 could not be found. Jun 24 09:54:40.184010 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: action_args: {'id': '84'} Jun 24 09:54:40.184010 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:54:40.184010 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:54:40.185036 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 09:54:40.185036 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 09:54:40.185036 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 09:54:40.185036 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 09:54:40.185036 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 09:54:40.185036 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 09:54:40.185036 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 09:54:40.185036 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 09:54:40.185036 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 09:54:40.185036 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:54:40.185036 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 09:54:40.185036 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 09:54:40.185036 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 24 09:54:40.185036 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi Jun 24 09:54:40.185036 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:54:40.185036 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi Jun 24 09:54:40.185036 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:54:40.185036 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:54:40.185036 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:54:40.186509 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:54:40.186509 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:54:40.186509 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:54:40.186509 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:54:40.186509 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 09:54:40.186509 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:54:40.186509 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 24 09:54:40.186509 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi Jun 24 09:54:40.186509 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:54:40.186509 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi Jun 24 09:54:40.186509 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:54:40.186509 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:54:40.186509 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:54:40.186509 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:54:40.186509 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:54:40.186509 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 24 09:54:40.186509 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi Jun 24 09:54:40.186509 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-be709d63-3208-49dd-8a2d-a940373aa158 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:54:40.187951 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-be709d63-3208-49dd-8a2d-a940373aa158 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061578 Jun 24 09:54:40.187951 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Fri Jun 24 09:54:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 09:54:40.193392 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-04ccbae6-4621-41d8-a170-b1a1aca2d55c admin admin] Calling method '>' {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:54:40.207360 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-04ccbae6-4621-41d8-a170-b1a1aca2d55c admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017542 Jun 24 09:54:40.207878 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Fri Jun 24 09:54:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:54:40.217023 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-1cea3497-5876-4aae-989b-407df2e83a02 admin admin] Calling method '>' {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:54:40.232179 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-1cea3497-5876-4aae-989b-407df2e83a02 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018548 Jun 24 09:54:40.232704 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Fri Jun 24 09:54:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:54:40.241757 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-df6e9f2c-5127-4607-9c2a-e7b15cc12d25 admin admin] Calling method '>' {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:54:40.247495 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.wsgi [None req-df6e9f2c-5127-4607-9c2a-e7b15cc12d25 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 24 09:54:40.249020 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-df6e9f2c-5127-4607-9c2a-e7b15cc12d25 admin admin] Request method failure captured: Jun 24 09:54:40.249020 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 24 09:54:40.249020 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: Accept: application/json Jun 24 09:54:40.249020 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: Accept-Encoding: gzip, deflate Jun 24 09:54:40.249020 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: Connection: keep-alive Jun 24 09:54:40.249020 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: Content-Length: 0 Jun 24 09:54:40.249020 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: Host: 10.222.0.26 Jun 24 09:54:40.249020 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: Openstack-Api-Version: compute 2.90 Jun 24 09:54:40.249020 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: Openstack-System-Scope: None Jun 24 09:54:40.249020 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: User-Agent: python-novaclient Jun 24 09:54:40.249020 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Auth-Token: gAAAAABitYnfIfPBCG_Mq2EP3LoIRqI5kr0R-a0ax5uOqnQjqairXc0ORCMwND1q0X5-swWg0-MfRf8D3txTt-J9S20OF-3PPBDq2vGgfQrVQoFzdbqjpSCmKNwl1tmVATcAfVU8H7LaLft1FGpyNllFDXtifUKefWcpL3N2y1b6KOdtccnxW70 Jun 24 09:54:40.249020 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Domain-Id: None Jun 24 09:54:40.249020 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Domain-Name: None Jun 24 09:54:40.249020 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Identity-Status: Confirmed Jun 24 09:54:40.249020 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Is-Admin-Project: True Jun 24 09:54:40.249020 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 09:54:40.249020 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Project-Domain-Id: default Jun 24 09:54:40.249020 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Project-Domain-Name: Default Jun 24 09:54:40.249020 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Project-Id: 59b0d627f4684928bf39233a009e998d Jun 24 09:54:40.249020 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Project-Name: admin Jun 24 09:54:40.249020 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Role: reader,member,admin Jun 24 09:54:40.249020 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Roles: reader,member,admin Jun 24 09:54:40.250527 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/59b0d627f4684928bf39233a009e998d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_59b0d627f4684928bf39233a009e998d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/59b0d627f4684928bf39233a009e998d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/59b0d627f4684928bf39233a009e998d"}]}] Jun 24 09:54:40.250527 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Tenant: admin Jun 24 09:54:40.250527 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Tenant-Id: 59b0d627f4684928bf39233a009e998d Jun 24 09:54:40.250527 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Tenant-Name: admin Jun 24 09:54:40.250527 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-User: admin Jun 24 09:54:40.250527 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-User-Domain-Id: default Jun 24 09:54:40.250527 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-User-Domain-Name: Default Jun 24 09:54:40.250527 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-User-Id: 0f4a4bc5e7eb43169051c22471d3be4c Jun 24 09:54:40.250527 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-User-Name: admin Jun 24 09:54:40.250527 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: method: > Jun 24 09:54:40.250527 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: exception: Flavor 84 could not be found. Jun 24 09:54:40.250527 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: action_args: {'id': '84'} Jun 24 09:54:40.250527 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:54:40.250527 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:54:40.251484 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 09:54:40.251484 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 09:54:40.251484 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 09:54:40.251484 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 09:54:40.251484 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 09:54:40.251484 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 09:54:40.251484 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 09:54:40.251484 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 09:54:40.251484 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 09:54:40.251484 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:54:40.251484 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 09:54:40.251484 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 09:54:40.251484 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 24 09:54:40.251484 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi Jun 24 09:54:40.251484 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:54:40.251484 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi Jun 24 09:54:40.251484 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:54:40.251484 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:54:40.251484 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:54:40.252583 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:54:40.252583 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:54:40.252583 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:54:40.252583 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:54:40.252583 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 09:54:40.252583 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:54:40.252583 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 24 09:54:40.252583 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi Jun 24 09:54:40.252583 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:54:40.252583 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi Jun 24 09:54:40.252583 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:54:40.252583 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:54:40.252583 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:54:40.252583 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:54:40.252583 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:54:40.252583 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 24 09:54:40.252583 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi Jun 24 09:54:40.252583 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-df6e9f2c-5127-4607-9c2a-e7b15cc12d25 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:54:40.253597 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-df6e9f2c-5127-4607-9c2a-e7b15cc12d25 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012038 Jun 24 09:54:40.253597 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Fri Jun 24 09:54:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 09:54:41.062228 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-1cea3497-5876-4aae-989b-407df2e83a02 admin admin] Calling method '>' {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:54:41.063241 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-1cea3497-5876-4aae-989b-407df2e83a02 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Jun 24 09:54:41.063635 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Jun 24 09:54:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:54:41.255614 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-f3e973f0-a977-4d8f-a2a3-f36694835995 admin admin] Calling method '>' {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:54:41.261709 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.wsgi [None req-f3e973f0-a977-4d8f-a2a3-f36694835995 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 24 09:54:41.263200 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-f3e973f0-a977-4d8f-a2a3-f36694835995 admin admin] Request method failure captured: Jun 24 09:54:41.263200 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 24 09:54:41.263200 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: Accept: application/json Jun 24 09:54:41.263200 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: Accept-Encoding: gzip, deflate Jun 24 09:54:41.263200 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: Connection: keep-alive Jun 24 09:54:41.263200 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: Content-Length: 0 Jun 24 09:54:41.263200 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: Host: 10.222.0.26 Jun 24 09:54:41.263200 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: Openstack-Api-Version: compute 2.90 Jun 24 09:54:41.263200 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: Openstack-System-Scope: None Jun 24 09:54:41.263200 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: User-Agent: python-novaclient Jun 24 09:54:41.263200 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Auth-Token: gAAAAABitYnhRy1Jp0fMb8kVq_ldIiIWaGNmPzXcKfGVKGkbaZb96wm7CM6a9NADGZ5BvuR1paw45vUs_EeIebdJJDNLVUbfxccthKGJ1tBCPSg94vKEGOZ2XRKrbw85sFSh0ikUPwhMP6E9qk04FWA1_ie0tZVguDMJ4lxjjrHchm7mSEypRqw Jun 24 09:54:41.263200 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Domain-Id: None Jun 24 09:54:41.263200 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Domain-Name: None Jun 24 09:54:41.263200 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Identity-Status: Confirmed Jun 24 09:54:41.263200 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Is-Admin-Project: True Jun 24 09:54:41.263200 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 09:54:41.263200 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Project-Domain-Id: default Jun 24 09:54:41.263200 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Project-Domain-Name: Default Jun 24 09:54:41.263200 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Project-Id: 59b0d627f4684928bf39233a009e998d Jun 24 09:54:41.263200 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Project-Name: admin Jun 24 09:54:41.263200 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Role: reader,member,admin Jun 24 09:54:41.263200 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Roles: reader,member,admin Jun 24 09:54:41.264770 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/59b0d627f4684928bf39233a009e998d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_59b0d627f4684928bf39233a009e998d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/59b0d627f4684928bf39233a009e998d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/59b0d627f4684928bf39233a009e998d"}]}] Jun 24 09:54:41.264770 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Tenant: admin Jun 24 09:54:41.264770 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Tenant-Id: 59b0d627f4684928bf39233a009e998d Jun 24 09:54:41.264770 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-Tenant-Name: admin Jun 24 09:54:41.264770 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-User: admin Jun 24 09:54:41.264770 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-User-Domain-Id: default Jun 24 09:54:41.264770 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-User-Domain-Name: Default Jun 24 09:54:41.264770 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-User-Id: 0f4a4bc5e7eb43169051c22471d3be4c Jun 24 09:54:41.264770 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: X-User-Name: admin Jun 24 09:54:41.264770 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: method: > Jun 24 09:54:41.264770 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: exception: Flavor 451 could not be found. Jun 24 09:54:41.264770 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: action_args: {'id': '451'} Jun 24 09:54:41.264770 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:54:41.264770 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:54:41.265768 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 09:54:41.265768 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 09:54:41.265768 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 09:54:41.265768 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 09:54:41.265768 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 09:54:41.265768 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 09:54:41.265768 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 09:54:41.265768 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 09:54:41.265768 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 09:54:41.265768 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:54:41.265768 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 09:54:41.265768 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 09:54:41.265768 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 24 09:54:41.265768 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi Jun 24 09:54:41.265768 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:54:41.265768 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi Jun 24 09:54:41.265768 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:54:41.265768 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:54:41.265768 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:54:41.267334 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:54:41.267334 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:54:41.267334 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:54:41.267334 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:54:41.267334 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 09:54:41.267334 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:54:41.267334 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 24 09:54:41.267334 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi Jun 24 09:54:41.267334 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:54:41.267334 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi Jun 24 09:54:41.267334 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:54:41.267334 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:54:41.267334 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:54:41.267334 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:54:41.267334 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:54:41.267334 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 24 09:54:41.267334 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: ERROR nova.api.openstack.wsgi Jun 24 09:54:41.267334 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-f3e973f0-a977-4d8f-a2a3-f36694835995 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110090) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:54:41.268717 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-f3e973f0-a977-4d8f-a2a3-f36694835995 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061469 Jun 24 09:54:41.268717 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Fri Jun 24 09:54:41 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 09:54:41.277119 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-01c961a7-94b8-440c-9084-c3b7e4bb726d admin admin] Calling method '>' {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:54:41.288600 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-01c961a7-94b8-440c-9084-c3b7e4bb726d admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017784 Jun 24 09:54:41.289128 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Fri Jun 24 09:54:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:54:41.299387 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-bd749f37-6951-46ed-887e-b77ccdfc4fee admin admin] Calling method '>' {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:54:41.312492 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-bd749f37-6951-46ed-887e-b77ccdfc4fee admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017410 Jun 24 09:54:41.313010 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Fri Jun 24 09:54:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 09:54:41.322441 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-d2a95049-2b67-417b-8023-873c17e05bd5 admin admin] Calling method '>' {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:54:41.327670 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.wsgi [None req-d2a95049-2b67-417b-8023-873c17e05bd5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 24 09:54:41.329189 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-d2a95049-2b67-417b-8023-873c17e05bd5 admin admin] Request method failure captured: Jun 24 09:54:41.329189 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 24 09:54:41.329189 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: Accept: application/json Jun 24 09:54:41.329189 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: Accept-Encoding: gzip, deflate Jun 24 09:54:41.329189 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: Connection: keep-alive Jun 24 09:54:41.329189 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: Content-Length: 0 Jun 24 09:54:41.329189 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: Host: 10.222.0.26 Jun 24 09:54:41.329189 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: Openstack-Api-Version: compute 2.90 Jun 24 09:54:41.329189 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: Openstack-System-Scope: None Jun 24 09:54:41.329189 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: User-Agent: python-novaclient Jun 24 09:54:41.329189 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Auth-Token: gAAAAABitYnhRy1Jp0fMb8kVq_ldIiIWaGNmPzXcKfGVKGkbaZb96wm7CM6a9NADGZ5BvuR1paw45vUs_EeIebdJJDNLVUbfxccthKGJ1tBCPSg94vKEGOZ2XRKrbw85sFSh0ikUPwhMP6E9qk04FWA1_ie0tZVguDMJ4lxjjrHchm7mSEypRqw Jun 24 09:54:41.329189 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Domain-Id: None Jun 24 09:54:41.329189 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Domain-Name: None Jun 24 09:54:41.329189 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Identity-Status: Confirmed Jun 24 09:54:41.329189 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Is-Admin-Project: True Jun 24 09:54:41.329189 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 09:54:41.329189 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Project-Domain-Id: default Jun 24 09:54:41.329189 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Project-Domain-Name: Default Jun 24 09:54:41.329189 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Project-Id: 59b0d627f4684928bf39233a009e998d Jun 24 09:54:41.329189 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Project-Name: admin Jun 24 09:54:41.329189 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Role: reader,member,admin Jun 24 09:54:41.329189 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Roles: reader,member,admin Jun 24 09:54:41.330694 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/59b0d627f4684928bf39233a009e998d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_59b0d627f4684928bf39233a009e998d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/59b0d627f4684928bf39233a009e998d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/59b0d627f4684928bf39233a009e998d"}]}] Jun 24 09:54:41.330694 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Tenant: admin Jun 24 09:54:41.330694 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Tenant-Id: 59b0d627f4684928bf39233a009e998d Jun 24 09:54:41.330694 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-Tenant-Name: admin Jun 24 09:54:41.330694 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-User: admin Jun 24 09:54:41.330694 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-User-Domain-Id: default Jun 24 09:54:41.330694 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-User-Domain-Name: Default Jun 24 09:54:41.330694 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-User-Id: 0f4a4bc5e7eb43169051c22471d3be4c Jun 24 09:54:41.330694 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: X-User-Name: admin Jun 24 09:54:41.330694 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: method: > Jun 24 09:54:41.330694 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: exception: Flavor 451 could not be found. Jun 24 09:54:41.330694 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: action_args: {'id': '451'} Jun 24 09:54:41.330694 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 09:54:41.330694 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:54:41.331659 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 09:54:41.331659 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 09:54:41.331659 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 09:54:41.331659 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 09:54:41.331659 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 09:54:41.331659 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 09:54:41.331659 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 09:54:41.331659 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 09:54:41.331659 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 09:54:41.331659 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:54:41.331659 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 09:54:41.331659 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 09:54:41.331659 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 24 09:54:41.331659 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi Jun 24 09:54:41.331659 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:54:41.331659 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi Jun 24 09:54:41.331659 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:54:41.331659 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:54:41.331659 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:54:41.332973 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 09:54:41.332973 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 09:54:41.332973 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 09:54:41.332973 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 09:54:41.332973 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 09:54:41.332973 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 09:54:41.332973 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 24 09:54:41.332973 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi Jun 24 09:54:41.332973 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 09:54:41.332973 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi Jun 24 09:54:41.332973 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 09:54:41.332973 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 09:54:41.332973 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 09:54:41.332973 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 09:54:41.332973 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 09:54:41.332973 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 24 09:54:41.332973 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: ERROR nova.api.openstack.wsgi Jun 24 09:54:41.332973 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-d2a95049-2b67-417b-8023-873c17e05bd5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110091) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 09:54:41.334167 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-d2a95049-2b67-417b-8023-873c17e05bd5 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012134 Jun 24 09:54:41.334167 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Fri Jun 24 09:54:41 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 09:54:42.147258 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-bd749f37-6951-46ed-887e-b77ccdfc4fee admin admin] Calling method '>' {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:54:42.148312 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-bd749f37-6951-46ed-887e-b77ccdfc4fee admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jun 24 09:54:42.148714 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Jun 24 09:54:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:54:42.336785 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-f0716bc5-2c9e-45fb-ac32-b2be367a4366 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:54:42.453316 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-f0716bc5-2c9e-45fb-ac32-b2be367a4366 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.167186 Jun 24 09:54:42.453787 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Fri Jun 24 09:54:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:54:43.273535 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-bd749f37-6951-46ed-887e-b77ccdfc4fee admin admin] Calling method '>' {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:54:43.275124 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-bd749f37-6951-46ed-887e-b77ccdfc4fee admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001990 Jun 24 09:54:43.275522 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Jun 24 09:54:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:54:43.465134 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-37490cb3-d15e-4ebb-8a01-781d4ba7d8df admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:54:43.538564 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-37490cb3-d15e-4ebb-8a01-781d4ba7d8df admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.125251 Jun 24 09:54:43.539030 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Fri Jun 24 09:54:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:54:44.359986 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-bd749f37-6951-46ed-887e-b77ccdfc4fee admin admin] Calling method '>' {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:54:44.361016 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-bd749f37-6951-46ed-887e-b77ccdfc4fee admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jun 24 09:54:44.361409 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Jun 24 09:54:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:54:44.550235 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-e135bd7b-fa2a-4d52-8d51-18d651972ab3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:54:44.619226 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-e135bd7b-fa2a-4d52-8d51-18d651972ab3 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.119600 Jun 24 09:54:44.619774 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Fri Jun 24 09:54:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:54:45.440424 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-bd749f37-6951-46ed-887e-b77ccdfc4fee admin admin] Calling method '>' {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:54:45.441429 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-bd749f37-6951-46ed-887e-b77ccdfc4fee admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jun 24 09:54:45.441823 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Jun 24 09:54:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:54:45.638516 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-172115de-1cd4-4d12-b6cb-6869bb32b4ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 09:54:45.750949 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-172115de-1cd4-4d12-b6cb-6869bb32b4ed admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.165189 Jun 24 09:54:45.751413 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Fri Jun 24 09:54:45 2022] POST /compute/v2.1/flavors => generated 409 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:54:46.568042 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-bd749f37-6951-46ed-887e-b77ccdfc4fee admin admin] Calling method '>' {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:54:46.569072 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-bd749f37-6951-46ed-887e-b77ccdfc4fee admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jun 24 09:54:46.569457 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Jun 24 09:54:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:54:46.757758 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-bed43597-03c2-49d6-9587-20d50aa6da21 admin admin] Calling method '>' {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:54:46.776812 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-bed43597-03c2-49d6-9587-20d50aa6da21 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069874 Jun 24 09:54:46.777278 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Fri Jun 24 09:54:46 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:55:33.330273 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-bd749f37-6951-46ed-887e-b77ccdfc4fee admin admin] Calling method '>' {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:55:33.331291 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-bd749f37-6951-46ed-887e-b77ccdfc4fee admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jun 24 09:55:33.331686 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 930 bytes} [Fri Jun 24 09:55:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:55:33.342396 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG dbcounter [-] [110091] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:55:33.391601 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-7ac85214-8967-4105-874e-290f2b4fabb3 admin admin] Calling method '>' {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:55:33.412000 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-7ac85214-8967-4105-874e-290f2b4fabb3 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073999 Jun 24 09:55:33.412595 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1291 bytes} [Fri Jun 24 09:55:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:55:33.435865 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-c5d9ee71-b107-4ebf-8702-f2d3083e0c40 admin admin] Calling method '>' {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:55:33.439387 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG dbcounter [-] [110090] Writing DB stats nova_api:SELECT=14 {{(pid=110090) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:55:33.444950 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-c5d9ee71-b107-4ebf-8702-f2d3083e0c40 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012722 Jun 24 09:55:33.450177 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1282 bytes} [Fri Jun 24 09:55:33 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:55:33.456528 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-52d7b6b9-90c8-4b6e-80b5-aa0cee89354d admin admin] Calling method '>' {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:55:33.465015 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-52d7b6b9-90c8-4b6e-80b5-aa0cee89354d admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012004 Jun 24 09:55:33.465551 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1285 bytes} [Fri Jun 24 09:55:33 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:55:33.477086 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-884f3568-f4f2-42fc-a632-065787e07b08 admin admin] Calling method '>' {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:55:33.484518 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-884f3568-f4f2-42fc-a632-065787e07b08 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011215 Jun 24 09:55:33.485031 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1285 bytes} [Fri Jun 24 09:55:33 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:55:33.495707 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-39394494-fdeb-4f9f-a5db-3047703315b7 admin admin] Calling method '>' {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:55:33.503059 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-39394494-fdeb-4f9f-a5db-3047703315b7 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010734 Jun 24 09:55:33.503563 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1282 bytes} [Fri Jun 24 09:55:33 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 09:58:55.881019 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-884f3568-f4f2-42fc-a632-065787e07b08 admin admin] Calling method '>' {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:58:55.882033 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-884f3568-f4f2-42fc-a632-065787e07b08 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jun 24 09:58:55.882427 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 34/69] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Jun 24 09:58:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:58:56.025482 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG dbcounter [-] [110091] Writing DB stats nova_api:SELECT=6 {{(pid=110091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:58:56.139772 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-88c07022-3147-405a-8a6b-a344ad09070b admin admin] Calling method '>' {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:58:56.141018 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:58:56.141018 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: warnings.warn(msg) Jun 24 09:58:56.142877 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG oslo_concurrency.lockutils [None req-88c07022-3147-405a-8a6b-a344ad09070b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:58:56.143308 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG oslo_concurrency.lockutils [None req-88c07022-3147-405a-8a6b-a344ad09070b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:58:56.144083 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG oslo_concurrency.lockutils [None req-88c07022-3147-405a-8a6b-a344ad09070b admin admin] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:58:56.144528 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG oslo_concurrency.lockutils [None req-88c07022-3147-405a-8a6b-a344ad09070b admin admin] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:58:56.178217 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-88c07022-3147-405a-8a6b-a344ad09070b admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.154269 Jun 24 09:58:56.178758 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 36/70] 10.222.0.26 () {60 vars in 1193 bytes} [Fri Jun 24 09:58:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:58:57.009364 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-884f3568-f4f2-42fc-a632-065787e07b08 admin admin] Calling method '>' {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:58:57.010359 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-884f3568-f4f2-42fc-a632-065787e07b08 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Jun 24 09:58:57.010748 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Jun 24 09:58:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:58:57.201375 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-3d530380-e379-4bbc-91d5-7cd4385a6120 admin admin] Calling method '>' {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:58:57.202538 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:58:57.202538 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: warnings.warn(msg) Jun 24 09:58:57.203787 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG oslo_concurrency.lockutils [None req-3d530380-e379-4bbc-91d5-7cd4385a6120 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:58:57.204751 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG oslo_concurrency.lockutils [None req-3d530380-e379-4bbc-91d5-7cd4385a6120 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:58:57.205551 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG oslo_concurrency.lockutils [None req-3d530380-e379-4bbc-91d5-7cd4385a6120 admin admin] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:58:57.205976 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG oslo_concurrency.lockutils [None req-3d530380-e379-4bbc-91d5-7cd4385a6120 admin admin] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:58:57.225742 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-3d530380-e379-4bbc-91d5-7cd4385a6120 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076687 Jun 24 09:58:57.226216 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 37/72] 10.222.0.26 () {60 vars in 1193 bytes} [Fri Jun 24 09:58:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 09:59:08.483495 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-884f3568-f4f2-42fc-a632-065787e07b08 admin admin] Calling method '>' {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:59:08.484567 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-884f3568-f4f2-42fc-a632-065787e07b08 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jun 24 09:59:08.484964 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 36/73] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Jun 24 09:59:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:59:08.627746 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG dbcounter [-] [110091] Writing DB stats nova_cell0:SELECT=4 {{(pid=110091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:59:08.629089 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG dbcounter [-] [110091] Writing DB stats nova_cell1:SELECT=4 {{(pid=110091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:59:08.629719 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG dbcounter [-] [110091] Writing DB stats nova_api:SELECT=8 {{(pid=110091) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:59:08.677186 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-5bb7e119-92e2-4722-9470-647a3653b53c admin admin] Calling method '>' {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:59:08.681574 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:59:08.681574 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: warnings.warn(msg) Jun 24 09:59:08.681574 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG oslo_concurrency.lockutils [None req-5bb7e119-92e2-4722-9470-647a3653b53c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:59:08.681574 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG oslo_concurrency.lockutils [None req-5bb7e119-92e2-4722-9470-647a3653b53c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:59:08.681574 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG oslo_concurrency.lockutils [None req-5bb7e119-92e2-4722-9470-647a3653b53c admin admin] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:59:08.681574 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG oslo_concurrency.lockutils [None req-5bb7e119-92e2-4722-9470-647a3653b53c admin admin] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:59:08.707157 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-5bb7e119-92e2-4722-9470-647a3653b53c admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083318 Jun 24 09:59:08.707643 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 38/74] 10.222.0.26 () {60 vars in 1193 bytes} [Fri Jun 24 09:59:08 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 09:59:09.535311 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: DEBUG nova.api.openstack.wsgi [None req-884f3568-f4f2-42fc-a632-065787e07b08 admin admin] Calling method '>' {{(pid=110090) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:59:09.536352 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: INFO nova.api.openstack.requestlog [None req-884f3568-f4f2-42fc-a632-065787e07b08 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jun 24 09:59:09.536745 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: [pid: 110090|app: 0|req: 37/75] 10.222.0.26 () {56 vars in 1074 bytes} [Fri Jun 24 09:59:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 09:59:09.728350 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG nova.api.openstack.wsgi [None req-b443015a-ea26-4ab5-80a8-c58faec4c0a6 admin admin] Calling method '>' {{(pid=110091) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 09:59:09.729502 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 09:59:09.729502 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: warnings.warn(msg) Jun 24 09:59:09.730948 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG oslo_concurrency.lockutils [None req-b443015a-ea26-4ab5-80a8-c58faec4c0a6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:59:09.731413 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG oslo_concurrency.lockutils [None req-b443015a-ea26-4ab5-80a8-c58faec4c0a6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:59:09.732490 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG oslo_concurrency.lockutils [None req-b443015a-ea26-4ab5-80a8-c58faec4c0a6 admin admin] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 09:59:09.732913 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: DEBUG oslo_concurrency.lockutils [None req-b443015a-ea26-4ab5-80a8-c58faec4c0a6 admin admin] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110091) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 09:59:09.754734 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: INFO nova.api.openstack.requestlog [None req-b443015a-ea26-4ab5-80a8-c58faec4c0a6 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077603 Jun 24 09:59:09.755213 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: [pid: 110091|app: 0|req: 39/76] 10.222.0.26 () {60 vars in 1193 bytes} [Fri Jun 24 09:59:09 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:00:08.392788 dv-cinder-843277-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 24 10:00:08.393404 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: Fri Jun 24 10:00:08 2022 - graceful shutdown triggered... Jun 24 10:00:08.393842 dv-cinder-843277-6-iscsi devstack@n-api.service[110090]: Gracefully killing worker 1 (pid: 110090)... Jun 24 10:00:08.394226 dv-cinder-843277-6-iscsi devstack@n-api.service[110091]: Gracefully killing worker 2 (pid: 110091)... Jun 24 10:00:09.394510 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: worker 1 buried after 1 seconds Jun 24 10:00:09.395049 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: worker 2 buried after 1 seconds Jun 24 10:00:09.395049 dv-cinder-843277-6-iscsi devstack@n-api.service[110089]: goodbye to uWSGI. Jun 24 10:00:09.396055 dv-cinder-843277-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 24 10:00:09.396632 dv-cinder-843277-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 24 10:00:09.399564 dv-cinder-843277-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 24 10:00:09.409099 dv-cinder-843277-6-iscsi devstack@n-api.service[124960]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 24 10:00:09.411786 dv-cinder-843277-6-iscsi devstack@n-api.service[124960]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 10:00:09 2022] *** Jun 24 10:00:09.411786 dv-cinder-843277-6-iscsi devstack@n-api.service[124960]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 10:00:09.411786 dv-cinder-843277-6-iscsi devstack@n-api.service[124960]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 10:00:09.411786 dv-cinder-843277-6-iscsi devstack@n-api.service[124960]: nodename: dv-cinder-843277-6-iscsi Jun 24 10:00:09.411786 dv-cinder-843277-6-iscsi devstack@n-api.service[124960]: machine: x86_64 Jun 24 10:00:09.411786 dv-cinder-843277-6-iscsi devstack@n-api.service[124960]: clock source: unix Jun 24 10:00:09.411786 dv-cinder-843277-6-iscsi devstack@n-api.service[124960]: pcre jit disabled Jun 24 10:00:09.411786 dv-cinder-843277-6-iscsi devstack@n-api.service[124960]: detected number of CPU cores: 4 Jun 24 10:00:09.411786 dv-cinder-843277-6-iscsi devstack@n-api.service[124960]: current working directory: / Jun 24 10:00:09.411786 dv-cinder-843277-6-iscsi devstack@n-api.service[124960]: detected binary path: /usr/bin/uwsgi-core Jun 24 10:00:09.411786 dv-cinder-843277-6-iscsi devstack@n-api.service[124960]: your processes number limit is 47680 Jun 24 10:00:09.412563 dv-cinder-843277-6-iscsi devstack@n-api.service[124960]: your memory page size is 4096 bytes Jun 24 10:00:09.412563 dv-cinder-843277-6-iscsi devstack@n-api.service[124960]: detected max file descriptor number: 2048 Jun 24 10:00:09.412563 dv-cinder-843277-6-iscsi devstack@n-api.service[124960]: lock engine: pthread robust mutexes Jun 24 10:00:09.412563 dv-cinder-843277-6-iscsi devstack@n-api.service[124960]: thunder lock: enabled Jun 24 10:00:09.412563 dv-cinder-843277-6-iscsi devstack@n-api.service[124960]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 24 10:00:09.412563 dv-cinder-843277-6-iscsi devstack@n-api.service[124960]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 10:00:09.459511 dv-cinder-843277-6-iscsi devstack@n-api.service[124960]: Python main interpreter initialized at 0x561d8b2e09c0 Jun 24 10:00:09.459511 dv-cinder-843277-6-iscsi devstack@n-api.service[124960]: python threads support enabled Jun 24 10:00:09.459511 dv-cinder-843277-6-iscsi devstack@n-api.service[124960]: your server socket listen backlog is limited to 100 connections Jun 24 10:00:09.459511 dv-cinder-843277-6-iscsi devstack@n-api.service[124960]: your mercy for graceful operations on workers is 90 seconds Jun 24 10:00:09.459937 dv-cinder-843277-6-iscsi devstack@n-api.service[124960]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 10:00:09.459937 dv-cinder-843277-6-iscsi devstack@n-api.service[124960]: *** Operational MODE: preforking *** Jun 24 10:00:09.463118 dv-cinder-843277-6-iscsi devstack@n-api.service[124960]: *** uWSGI is running in multiple interpreter mode *** Jun 24 10:00:09.463118 dv-cinder-843277-6-iscsi devstack@n-api.service[124960]: spawned uWSGI master process (pid: 124960) Jun 24 10:00:09.463118 dv-cinder-843277-6-iscsi devstack@n-api.service[124960]: spawned uWSGI worker 1 (pid: 124979, cores: 1) Jun 24 10:00:09.460480 dv-cinder-843277-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 24 10:00:09.465864 dv-cinder-843277-6-iscsi devstack@n-api.service[124960]: spawned uWSGI worker 2 (pid: 124980, cores: 1) Jun 24 10:00:09.466125 dv-cinder-843277-6-iscsi devstack@n-api.service[124960]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 10:00:10.122149 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 10:00:10.134786 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 10:00:11.329122 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 10:00:11.329122 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: from cryptography.utils import int_from_bytes Jun 24 10:00:11.329838 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 10:00:11.329838 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: from cryptography.utils import int_from_bytes Jun 24 10:00:11.334712 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 10:00:11.334712 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: from cryptography.utils import int_from_bytes Jun 24 10:00:11.335208 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 10:00:11.335208 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: from cryptography.utils import int_from_bytes Jun 24 10:00:13.700943 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 10:00:13.701502 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 10:00:13.701737 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 10:00:13.702102 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 10:00:13.702359 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 10:00:13.702748 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.703074 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.703888 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.703888 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.704059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.704342 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.704664 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.704991 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.705319 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.705581 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.705896 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.706224 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843277-6-iscsi {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.706547 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.706866 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.707168 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.708324 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.708324 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.708324 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.708594 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.708893 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.709701 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.709701 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.709999 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.710669 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.710669 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.710860 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.711145 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.711629 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.711952 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.712285 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.712688 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843277-6-iscsi {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.713006 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.713318 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.713632 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.714050 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.714359 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.714704 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.715030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.715365 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.715757 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.716085 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.716429 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.716747 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.717065 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.717365 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.717672 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.717846 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 10:00:13.718263 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.718360 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 10:00:13.718442 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.718631 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.718741 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 10:00:13.718879 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.718997 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 10:00:13.719135 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.719240 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 10:00:13.719430 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.719611 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.719732 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.719949 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.720105 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.720314 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.720493 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.720651 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.720809 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.720915 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.721002 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.721166 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.721293 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.721483 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.721584 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.721786 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.721878 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.722091 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.722197 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.722394 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.722493 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.722697 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.722789 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.722999 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.723097 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843277-6-iscsi {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.723301 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.723393 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.723602 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.723692 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.723904 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.724002 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.724244 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.724352 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.724558 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.724657 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.724877 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.724978 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.725185 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.725283 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.725507 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.725697 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.725898 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.726019 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.726149 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.726311 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.726452 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.726627 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.726792 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.726982 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.727109 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.727282 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.727423 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.727600 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.727722 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.727927 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.728082 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.728249 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.728404 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.728582 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.728735 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.728881 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.729042 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.729209 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.729348 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843277-6-iscsi {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.729528 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.729678 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.729827 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.729979 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.730124 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.730764 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.730931 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.731132 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.731285 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.731435 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.731586 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.731743 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.731926 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.732063 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.732192 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.732388 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.732539 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.732729 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.732942 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.733124 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.733298 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.733298 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.736170 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.736365 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.736456 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.736543 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.736624 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.736697 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.736773 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.736873 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.736949 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.737020 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.740507 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.740701 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.740879 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.741057 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.741223 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.741385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.741541 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.741690 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.741856 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.742012 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.742167 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.742314 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.742471 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.742633 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.742794 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.742949 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.743106 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.743106 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.743407 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.743561 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.743710 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.743856 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.744012 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.744190 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.744352 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.744514 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.744671 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.744835 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.744992 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.745138 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.745291 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.745437 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.745590 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.745737 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.745939 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.746603 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.746752 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.746898 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.747044 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.747189 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.747359 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.747517 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.747768 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.747768 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.748174 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.748341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.748490 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.748642 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.748903 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.749058 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.749205 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.749383 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.749614 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.749785 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.750042 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.750287 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.750466 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.750870 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.751071 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.751258 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.751449 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.751634 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.751824 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.752020 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.752225 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.752464 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.752657 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.752851 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.753045 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.753239 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.753430 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.753621 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.753813 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.754002 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.754199 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.754391 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.754583 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.754766 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.754959 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.755149 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.755345 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.755345 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.755704 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.755894 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.756065 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.756279 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.756428 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.756574 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.756727 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.756881 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.757033 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.757199 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.757347 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.757501 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.757654 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.757898 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.758136 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.758312 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.758462 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.758607 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.758761 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.758926 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.759160 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.759336 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.759485 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.759661 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.759888 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.760063 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.760477 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.760646 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.760936 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.761089 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.761245 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.761392 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.761554 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.761708 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.761873 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.762029 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.762186 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.762342 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.762499 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.762654 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.762800 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.762960 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.763106 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.763106 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.763389 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.763541 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.763705 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.763705 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.764003 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.764003 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.764315 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.764462 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.764618 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.764774 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.764929 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.765076 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.765221 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.765366 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.765529 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.765684 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.765840 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.765985 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.766138 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.766284 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.766438 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.766584 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.766740 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.766895 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.767051 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.767197 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.767352 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.767498 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.767652 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.767807 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.768055 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.768408 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.768563 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.768726 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.768875 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.769031 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.769203 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.769439 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.769589 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.769745 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.769910 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.770325 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.770629 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.770790 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.771082 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.771255 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.771404 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.771550 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.771703 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.771857 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.772014 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.772014 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.772507 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.772663 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:00:13.772831 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.772831 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.773133 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.773288 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.773444 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.773599 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.773745 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.773890 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.774051 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.774207 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.774362 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.774518 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.774678 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.774834 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.774991 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.775139 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.775371 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.775532 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.775680 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.775837 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.775984 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.776151 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.776305 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.776462 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.776617 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.776793 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.776949 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.777106 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.777263 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.777409 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.777555 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.777710 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.777856 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.778027 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.778250 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.778485 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.778646 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.778808 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.778974 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.779122 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.779275 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.779449 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.779787 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.779942 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.779942 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.780343 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.780498 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.780727 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.781124 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.781282 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.781449 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.781604 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.781752 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.781898 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.782059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.782215 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.782369 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.782529 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.782683 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.782838 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.783004 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.783151 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.783296 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.783459 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.783607 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.783776 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.783930 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.784635 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.784796 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.784956 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.785111 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.785272 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.785427 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.785582 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.785730 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.785882 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.786081 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.786241 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.786397 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.786551 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.786707 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.786861 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.787021 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.787180 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.787328 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.787482 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.787636 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.787790 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.787946 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.788103 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.788380 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.788796 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.788968 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.789715 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.789993 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.790157 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.790321 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.790555 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.790732 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.790962 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.791297 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.791461 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.791640 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.791874 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.792027 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.792203 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.792366 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.792521 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.793169 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.793334 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.793489 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.793645 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.794040 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.794191 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.794348 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.794500 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.794658 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.794820 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.794974 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.795121 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.795274 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.795431 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.795577 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.795731 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.795879 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.796023 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.796242 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.796406 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.796560 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.796716 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.796870 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.797015 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.797172 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.797326 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.797472 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.797630 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.797784 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.797938 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.798092 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.798247 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.798439 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.798746 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.798901 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.799048 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.799193 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.799339 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.799496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.799651 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.799805 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.799979 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.800233 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.800387 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.800567 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.800800 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.800978 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.801201 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.801488 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.801488 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.802017 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.802341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.802517 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.802667 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.802813 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.802979 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.803127 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.803286 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.803432 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.803578 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.803731 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.803893 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.804040 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.804207 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.804368 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.804532 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.804682 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.804843 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.804991 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.805145 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.805310 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.805465 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.805614 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.805774 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.805922 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.806068 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.806214 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.806360 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.806516 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.806665 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.806823 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.806970 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.807123 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.807289 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.807456 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.807603 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.807757 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.807905 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.808059 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.808256 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.808463 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.808613 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.808934 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.809089 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.809244 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.809399 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.809572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.809728 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.809883 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.810080 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.810080 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.810486 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.810647 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.810823 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.811056 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.811226 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.811580 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.811746 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.811894 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.812059 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.812453 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.812622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.812772 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.812933 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.813088 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.813242 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.813388 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.813548 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.813695 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.813854 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.814011 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.814169 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.814323 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.814470 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.814636 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.814792 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.814938 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.815084 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.815240 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.815387 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.815547 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.815702 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.815848 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.816002 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.816177 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.816341 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.816504 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.816652 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.816796 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.816949 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.817104 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.817104 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.817395 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.817582 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.817747 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.817902 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.818193 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.818373 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.818530 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.818677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.818981 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.819138 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.819287 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.819447 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.819594 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.819748 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.819895 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.820162 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.820320 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.820502 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.820764 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.820925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.821100 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.821325 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.821676 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.821846 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.821995 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.822140 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.822288 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.822441 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.822695 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.822857 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.823005 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.823005 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.823313 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.823462 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.823618 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.823765 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.823911 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.824597 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.824744 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.824889 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.825061 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.825220 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.825376 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.825545 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.825701 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.825856 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.826013 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.826159 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.826304 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.826457 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.826615 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.826770 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.826925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.827079 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.827226 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.827386 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.827543 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.827691 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.827844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.827998 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.828293 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.828472 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.828622 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.828776 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.828934 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.829259 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.829412 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.829572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.829720 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.829974 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.830151 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.830301 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.830457 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.830604 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.830770 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.831014 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.831174 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.831340 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.831593 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.831897 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.832046 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.832224 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.832385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.832556 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.832897 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.833100 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.833258 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.833405 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.833558 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.833715 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.833881 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.834035 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.834188 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.834349 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.834517 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.834695 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.834850 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.835018 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.835176 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.835338 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.835499 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.835666 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.835820 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.835983 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.836866 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.837662 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.837844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.838025 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.838182 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.838360 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.838600 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.838769 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.838940 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.839096 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.839415 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.839637 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.839809 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.839964 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.840189 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.840360 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.840535 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.840690 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.840842 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.840842 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.841213 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.841455 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.841716 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.842124 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.842297 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.842464 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.842634 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.842797 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.843062 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.843273 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.843428 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.843597 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.843752 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.843913 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.844067 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.844243 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.844398 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.844568 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.844723 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.844884 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.845053 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.845229 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.845392 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.845556 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.845556 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.845858 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.846011 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.846163 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.846316 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.846483 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.846638 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.846791 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.846944 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.847096 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.847270 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.847433 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.847596 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.847751 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.847904 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.848065 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.848278 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.848442 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.848617 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.848859 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.849029 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.849192 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.849365 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.849687 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.849852 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.850021 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.850175 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.850328 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.850490 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.850645 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.850806 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.850982 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.851137 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.851290 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.851450 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.851604 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.851885 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.852319 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.852522 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.852697 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.852853 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.853014 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.853285 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.853456 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.853612 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.853765 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.853925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.854087 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.854262 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.854426 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.854588 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.854741 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.854895 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.854895 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.855731 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.855895 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.856203 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.856367 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.856520 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.856680 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.856849 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.857024 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.857178 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.857339 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.857492 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.857652 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.857815 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.857971 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.858130 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.858285 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.858444 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.858607 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.858761 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.859005 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.859181 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.859345 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.859662 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.859837 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.860001 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.860177 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.860349 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.860504 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.860665 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.860899 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.861063 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.861225 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.861380 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.861544 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.861697 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.861883 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.862142 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.862525 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.862685 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.862685 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.862985 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.863150 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.863328 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.863579 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.863741 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.863914 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.864084 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.864265 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.864432 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.864587 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.864747 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.864907 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.865071 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.865225 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.865386 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.865546 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.865710 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.865872 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.866046 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.866200 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.866353 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.866505 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.866664 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.866824 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.866991 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.867153 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.867307 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.867467 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.867620 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.867782 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.867936 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.868103 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.868338 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.868504 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.868668 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.868832 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.869014 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.869247 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.869407 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.869561 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.869859 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.870029 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.870327 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.870511 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.870690 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.870907 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.871561 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.871739 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.871896 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.872057 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.872318 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.872700 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.872880 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.873046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.873208 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.873369 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.873536 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.873804 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.876468 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.876663 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.876840 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.877001 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.877166 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.877322 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.877492 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.877657 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.877812 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.877966 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.878130 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.878297 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.878460 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.878615 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.878760 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.878893 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.878997 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.879094 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.879183 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.879340 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.879439 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.879535 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.879677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.880056 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.880205 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.880336 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.880461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.880585 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.880709 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.880834 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.880957 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.881081 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.881203 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.881318 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.881439 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.881567 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.881682 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.881795 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.881915 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.882029 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.882153 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.882346 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.882563 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.882922 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.883041 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.883164 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.883288 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.883410 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.883543 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.884352 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.884352 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.884602 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.884729 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.884852 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.884973 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.885101 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.885225 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.885338 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.885461 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.885587 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.885705 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.885827 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.885941 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.886111 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.886240 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.886355 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.886495 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.886622 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.886737 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.886865 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.886988 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.887101 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.887221 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.887335 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.887456 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.887579 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.887703 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.887825 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.887946 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.888059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.888235 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.888386 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.888510 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.888623 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.888744 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.888885 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.889021 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.889136 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.889258 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.889373 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.889486 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.889613 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.889735 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.889857 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.890146 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.890278 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.890392 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.890512 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.890641 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.890763 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.890884 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.890996 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.891116 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.891229 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.891355 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.891476 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.891591 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.891708 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.891820 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.891942 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.892063 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.892208 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.892336 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.892456 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.892663 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.893103 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.893237 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.893353 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.893474 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.893588 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.893701 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.893829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.893952 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.894065 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.894178 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.894290 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.894515 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.894646 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.894778 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.894906 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.895027 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.895156 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.895279 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.895393 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.895513 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.895646 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.895761 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.895882 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.895996 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.896108 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.896256 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.896391 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.896521 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.896643 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.896766 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.896887 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.897009 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.897122 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.897254 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.897377 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.897491 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.897602 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.897715 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.897837 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.897964 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.898086 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.898346 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.898469 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.898583 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.898696 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.898819 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.898942 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.899065 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.899197 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.899320 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.899443 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.899557 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.899705 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.899828 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.899941 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.900308 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.900463 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.900463 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.900678 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.900799 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.900922 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.901037 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.901160 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.901274 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.901386 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.901506 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.901626 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.901747 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.901874 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.901874 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.901874 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.901874 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.902334 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.902533 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.902671 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.902888 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.903207 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.903323 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.903444 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.903572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.903693 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.903814 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.903935 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.904056 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.904201 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.904956 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.905083 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.905199 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.905319 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.905434 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.905562 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.905697 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.905813 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.905926 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.906039 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.906159 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.906295 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.906418 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.906532 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.906652 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.906765 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.906877 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.906999 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.907121 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.907235 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.907348 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.907460 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.907572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.907699 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.907821 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.907936 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.908049 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.908236 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.908458 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.908590 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.908706 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.908820 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.908940 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.909055 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.909182 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.909326 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.909448 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.909570 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.909683 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.909803 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.909947 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.910069 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.910181 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.910417 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.910622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.910743 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.910866 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.910866 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.911085 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.911200 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.911321 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.911436 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.911615 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.911731 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.911853 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.911967 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.912079 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.912230 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.912348 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.912460 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.912573 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.913517 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.913645 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.913773 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.913895 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.914017 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.914131 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.914244 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.914357 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.914485 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.914601 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.914739 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.914951 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.915081 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.915196 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.915324 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.915445 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.915569 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.915688 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.915802 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.915930 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.916052 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.916184 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.916315 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.916440 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.916553 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.916676 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.916794 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.916907 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.917020 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.917133 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.917259 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.917374 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.917486 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.917606 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.918242 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.918367 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.918584 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.918714 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.919081 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.919202 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.919325 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.919445 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.919595 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.919717 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.919830 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.919950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.920094 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.920294 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.920439 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.920646 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.920834 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.921551 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.921684 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.921818 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.921944 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.922058 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.922172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.922283 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.922397 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.922519 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.922642 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.922764 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.922878 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.922999 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.923112 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.923112 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.923340 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.923712 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.923827 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.923956 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.924090 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.924231 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.924357 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.924482 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.924606 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.924720 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.924843 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.924989 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.925203 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.925331 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.925445 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.925558 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.925681 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.925803 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.925923 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.926053 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.926179 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.926293 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.926419 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.926534 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.926647 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.926759 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.926878 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.927007 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.927248 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.927438 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.927592 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.927592 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.927816 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.927940 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.928055 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.928055 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.928322 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.928448 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.928582 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.928779 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.928907 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.929029 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.929149 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.929264 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.929384 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.929507 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.929621 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.929733 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.929876 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.930005 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.930128 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.930250 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.930363 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.930475 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.930614 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.930614 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.931126 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.931244 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.931358 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.931471 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.931591 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.931706 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.931829 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.931943 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.932077 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.932216 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.932331 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.932473 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.932589 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.934592 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.934733 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.934854 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.934984 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.935433 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.935564 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.935696 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.935812 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.935935 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.936058 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.936237 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.936382 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.936509 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.936626 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.936789 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.936920 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.937035 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.937158 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.937285 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.937408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.937530 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.937644 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.937802 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.937939 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.938055 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.938167 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.938288 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.938288 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.938508 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.938635 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.938770 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.938970 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.939099 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.939222 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.939343 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.939343 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.939649 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.939765 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.939886 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.939999 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.940152 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.940152 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.940412 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.940527 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.940654 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.940769 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.941159 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.941282 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.941397 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.941508 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.941629 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.941750 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.941875 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.941990 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.942110 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.942222 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.942334 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.942334 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.942566 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.942681 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.942793 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.942914 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.943035 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.943155 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.943336 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.943457 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.943570 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.943682 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.943795 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.943927 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.944042 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.944311 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.944555 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.944675 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.944788 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.944916 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.945033 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.945033 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.945254 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.945377 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.945509 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.945736 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.946476 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.946620 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.946743 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.946857 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.946981 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.947336 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.947456 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.947577 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.947692 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.947805 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.947937 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.948061 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.948198 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.948317 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.948445 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.948556 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.948659 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.948748 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.948833 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.948963 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.949062 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.949151 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.949253 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.949348 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.949442 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.949531 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.949615 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.949710 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.949797 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.949918 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.950006 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.950100 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.950194 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.950303 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.950394 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.950480 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.950566 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.950650 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.950735 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.950834 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.950922 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.951033 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.952221 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.952353 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.952461 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.952553 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.952646 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.952646 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.952819 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.952912 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.953019 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.953114 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.953200 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.953292 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.953385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.953487 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.953588 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.953681 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.953767 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.953851 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.953942 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.954037 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.954132 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.954225 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.954317 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.954406 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.954491 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.954588 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.954669 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.954762 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.954847 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.954931 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.955013 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.955109 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.955195 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.955279 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.955370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.955455 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.955546 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.955640 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.955725 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.955811 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.955903 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.955989 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.956079 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.956208 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.956306 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.956306 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.956483 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.956578 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.956678 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.956772 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.956772 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.956926 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.957010 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.957103 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.957198 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.957285 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.957368 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.957451 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.957534 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.957625 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.957718 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.957811 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.957897 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.957980 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.958072 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.958164 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.958261 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.958347 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.958430 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.958513 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.958604 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.958703 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.958796 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.958881 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.958972 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.959057 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.959160 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.959250 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.959343 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.959343 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.959509 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.959594 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.959677 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.959677 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.959840 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.959923 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.960020 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.960112 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.960237 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.960324 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.960424 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.960508 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.960610 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.960610 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.960835 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.960924 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.961007 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.961097 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.961183 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.961288 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.961388 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.961388 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.961526 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.961611 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.961611 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.961764 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.961856 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.961941 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.962020 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.962020 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.962164 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.962250 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.962339 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.962421 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.962494 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.962573 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.962652 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.962652 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.962791 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.962863 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.962943 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.963015 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.963087 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.963167 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.963240 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.963319 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.963399 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.963471 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.963559 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.963639 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.963712 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.963792 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.963864 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.963935 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.964015 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.964088 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.964969 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.965137 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.965287 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.965429 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.965579 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.965728 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.965866 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.966018 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.966158 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.966330 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.966474 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.966617 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.966761 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.966909 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.967052 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.967203 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.967345 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.967486 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.967626 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.967766 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.967906 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.968056 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.968224 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.968363 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.968515 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.968664 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.968813 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.968961 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.969103 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.969252 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.969404 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.969508 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.969605 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.969693 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.969787 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.969873 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.969957 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.969957 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.970176 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.970176 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.970386 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.970480 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 10:00:13.970582 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.970582 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.970582 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.970582 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.970582 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.970582 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.970582 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.970582 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.971156 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.971156 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.971156 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.971156 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.971156 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.971156 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.971156 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.971156 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.971841 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.971841 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.971841 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.971841 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.971841 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.971841 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.971841 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.971841 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.972535 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.972535 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.972535 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.972535 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.972535 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.972535 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.972535 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.972535 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.973146 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.973146 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.973146 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.973146 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.973146 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.973530 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.973530 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.973827 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.974144 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.974460 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.974783 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.975107 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.975440 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.975776 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.976091 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.976449 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.976781 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.977137 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.977460 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.977810 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.978530 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.978530 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.978782 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.979072 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:00:13.979343 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124980) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 10:00:14.023287 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO dbcounter [None req-f035438e-bf60-40e3-8d5c-a538837f5a1b None None] Registered counter for database nova_api Jun 24 10:00:14.044202 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_db.sqlalchemy.engines [None req-f035438e-bf60-40e3-8d5c-a538837f5a1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124979) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:00:14.045240 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO dbcounter [None req-fb318474-d9ef-472a-ab4c-8b7ffd2c02a1 None None] Registered counter for database nova_api Jun 24 10:00:14.050771 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writer thread running {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:00:14.065881 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_db.sqlalchemy.engines [None req-fb318474-d9ef-472a-ab4c-8b7ffd2c02a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124980) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:00:14.072462 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writer thread running {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:00:14.106674 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.context [None req-f035438e-bf60-40e3-8d5c-a538837f5a1b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fe31d9cf-df6b-4323-b574-c2625778abf9(cell1) {{(pid=124979) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 10:00:14.110749 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f035438e-bf60-40e3-8d5c-a538837f5a1b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:00:14.112390 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f035438e-bf60-40e3-8d5c-a538837f5a1b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:00:14.113188 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f035438e-bf60-40e3-8d5c-a538837f5a1b None None] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:00:14.115115 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f035438e-bf60-40e3-8d5c-a538837f5a1b None None] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:00:14.117134 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO dbcounter [None req-f035438e-bf60-40e3-8d5c-a538837f5a1b None None] Registered counter for database nova_cell0 Jun 24 10:00:14.121606 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO dbcounter [None req-f035438e-bf60-40e3-8d5c-a538837f5a1b None None] Registered counter for database nova_cell1 Jun 24 10:00:14.129447 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_db.sqlalchemy.engines [None req-f035438e-bf60-40e3-8d5c-a538837f5a1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124979) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:00:14.129630 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.context [None req-fb318474-d9ef-472a-ab4c-8b7ffd2c02a1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fe31d9cf-df6b-4323-b574-c2625778abf9(cell1) {{(pid=124980) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 10:00:14.130669 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_db.sqlalchemy.engines [None req-f035438e-bf60-40e3-8d5c-a538837f5a1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124979) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:00:14.133734 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-fb318474-d9ef-472a-ab4c-8b7ffd2c02a1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:00:14.135337 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-fb318474-d9ef-472a-ab4c-8b7ffd2c02a1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:00:14.136156 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-fb318474-d9ef-472a-ab4c-8b7ffd2c02a1 None None] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:00:14.137766 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writer thread running {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:00:14.138669 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-fb318474-d9ef-472a-ab4c-8b7ffd2c02a1 None None] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:00:14.139898 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writer thread running {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:00:14.140708 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO dbcounter [None req-fb318474-d9ef-472a-ab4c-8b7ffd2c02a1 None None] Registered counter for database nova_cell0 Jun 24 10:00:14.144688 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO dbcounter [None req-fb318474-d9ef-472a-ab4c-8b7ffd2c02a1 None None] Registered counter for database nova_cell1 Jun 24 10:00:14.151917 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_db.sqlalchemy.engines [None req-fb318474-d9ef-472a-ab4c-8b7ffd2c02a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124980) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:00:14.154191 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_db.sqlalchemy.engines [None req-fb318474-d9ef-472a-ab4c-8b7ffd2c02a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124980) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:00:14.159591 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writer thread running {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:00:14.161206 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writer thread running {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:00:14.292567 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO dbcounter [None req-f035438e-bf60-40e3-8d5c-a538837f5a1b None None] Registered counter for database nova_cell0 Jun 24 10:00:14.299691 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_db.sqlalchemy.engines [None req-f035438e-bf60-40e3-8d5c-a538837f5a1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124979) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:00:14.305320 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writer thread running {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:00:14.313165 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO dbcounter [None req-fb318474-d9ef-472a-ab4c-8b7ffd2c02a1 None None] Registered counter for database nova_cell0 Jun 24 10:00:14.319808 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_db.sqlalchemy.engines [None req-fb318474-d9ef-472a-ab4c-8b7ffd2c02a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124980) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:00:14.325002 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writer thread running {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:00:14.629888 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: WARNING keystonemiddleware.auth_token [None req-f035438e-bf60-40e3-8d5c-a538837f5a1b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 10:00:14.637870 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: WARNING keystonemiddleware.auth_token [None req-f035438e-bf60-40e3-8d5c-a538837f5a1b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 10:00:14.643279 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: WARNING keystonemiddleware.auth_token [None req-fb318474-d9ef-472a-ab4c-8b7ffd2c02a1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 10:00:14.650530 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: WARNING keystonemiddleware.auth_token [None req-fb318474-d9ef-472a-ab4c-8b7ffd2c02a1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 10:00:14.984034 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: WARNING keystonemiddleware.auth_token [None req-f035438e-bf60-40e3-8d5c-a538837f5a1b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 10:00:14.990087 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: WARNING keystonemiddleware.auth_token [None req-f035438e-bf60-40e3-8d5c-a538837f5a1b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 10:00:14.994629 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: WARNING keystonemiddleware.auth_token [None req-fb318474-d9ef-472a-ab4c-8b7ffd2c02a1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 10:00:14.995469 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561d8b2e09c0 pid: 124979 (default app) Jun 24 10:00:15.001065 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: WARNING keystonemiddleware.auth_token [None req-fb318474-d9ef-472a-ab4c-8b7ffd2c02a1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 10:00:15.006310 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561d8b2e09c0 pid: 124980 (default app) Jun 24 10:00:56.435368 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_api:SELECT=3 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:00:56.437000 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=3 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:00:56.438126 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell0:SELECT=3 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:00:56.439529 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell0:SELECT=3 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:00:56.738755 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_api:SELECT=3 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:00:56.740452 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=3 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:00:56.741414 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell0:SELECT=3 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:00:56.745815 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell0:SELECT=3 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:00:57.567646 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-730c263f-4733-451a-9819-3f03ddc810fb tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] Action: 'create', calling method: .version_select at 0x7f030ba99700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1524553747"}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:00:57.733868 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-7c37ae1b-633f-4404-a73c-907378c2b4d5 tempest-VolumesGetTestJSON-1228188400 tempest-VolumesGetTestJSON-1228188400-project] Action: 'create', calling method: .version_select at 0x7f030ba97790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1531968229", "metadata": {"Type": "work"}}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:00:59.325773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-730c263f-4733-451a-9819-3f03ddc810fb tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.903180 Jun 24 10:00:59.343806 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1154 bytes} [Fri Jun 24 10:00:56 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2923 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 24 10:00:59.363404 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-46223d44-c443-4ef3-99dc-cab90a05bbfa tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] Calling method '.version_select at 0x7f030b95d5e0>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:00:59.386329 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-7c37ae1b-633f-4404-a73c-907378c2b4d5 tempest-VolumesGetTestJSON-1228188400 tempest-VolumesGetTestJSON-1228188400-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.653968 Jun 24 10:00:59.387226 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 1/2] 10.222.0.26 () {60 vars in 1155 bytes} [Fri Jun 24 10:00:56 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2657 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 24 10:00:59.419719 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-263ea164-c4f4-447c-9475-3d1c13263786 tempest-VolumesGetTestJSON-1228188400 tempest-VolumesGetTestJSON-1228188400-project] Calling method '.version_select at 0x7f030b95e550>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:00:59.479537 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-46223d44-c443-4ef3-99dc-cab90a05bbfa tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/174378d9-26d1-4740-8e71-f6d101b02b09" status: 200 len: 345 microversion: 2.1 time: 0.128986 Jun 24 10:00:59.480917 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1244 bytes} [Fri Jun 24 10:00:59 2022] GET /compute/v2.1/os-volumes/174378d9-26d1-4740-8e71-f6d101b02b09 => generated 345 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:00:59.584240 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-263ea164-c4f4-447c-9475-3d1c13263786 tempest-VolumesGetTestJSON-1228188400 tempest-VolumesGetTestJSON-1228188400-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/51e613e2-5414-43eb-813d-412d718e0e58" status: 200 len: 353 microversion: 2.1 time: 0.186588 Jun 24 10:00:59.589417 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1244 bytes} [Fri Jun 24 10:00:59 2022] GET /compute/v2.1/os-volumes/51e613e2-5414-43eb-813d-412d718e0e58 => generated 353 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:00.339194 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-1c3e400b-1825-473c-aa7c-6707e08fd2db tempest-VolumesTestJSON-883318951 tempest-VolumesTestJSON-883318951-project] Calling method '.version_select at 0x7f030b95d940>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:00.658713 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-1c3e400b-1825-473c-aa7c-6707e08fd2db tempest-VolumesTestJSON-883318951 tempest-VolumesTestJSON-883318951-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/239ff609-c072-4994-95ba-d80d28765134" status: 200 len: 351 microversion: 2.1 time: 0.139225 Jun 24 10:01:00.658713 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 3/5] 10.222.0.26 () {58 vars in 1244 bytes} [Fri Jun 24 10:01:00 2022] GET /compute/v2.1/os-volumes/239ff609-c072-4994-95ba-d80d28765134 => generated 351 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:00.691786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-a50a9b5d-644e-4d0b-bd95-e238d823afd6 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] Calling method '.version_select at 0x7f030b95ec10>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:00.693136 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-22c26594-d865-4155-98eb-96309a2c91a2 tempest-VolumesGetTestJSON-1228188400 tempest-VolumesGetTestJSON-1228188400-project] Calling method '.version_select at 0x7f030b95ddc0>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:00.797221 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-a50a9b5d-644e-4d0b-bd95-e238d823afd6 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/174378d9-26d1-4740-8e71-f6d101b02b09" status: 200 len: 346 microversion: 2.1 time: 0.307530 Jun 24 10:01:00.797797 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 3/6] 10.222.0.26 () {58 vars in 1244 bytes} [Fri Jun 24 10:01:00 2022] GET /compute/v2.1/os-volumes/174378d9-26d1-4740-8e71-f6d101b02b09 => generated 346 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:00.813815 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-5cf8c8d2-523a-4335-b5f2-317e52716612 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] Action: 'create', calling method: .version_select at 0x7f030b95ee50>, body: {"snapshot": {"volume_id": "174378d9-26d1-4740-8e71-f6d101b02b09", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-40049938"}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:01:00.871369 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-22c26594-d865-4155-98eb-96309a2c91a2 tempest-VolumesGetTestJSON-1228188400 tempest-VolumesGetTestJSON-1228188400-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/51e613e2-5414-43eb-813d-412d718e0e58" status: 200 len: 354 microversion: 2.1 time: 0.278159 Jun 24 10:01:00.872090 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1244 bytes} [Fri Jun 24 10:01:00 2022] GET /compute/v2.1/os-volumes/51e613e2-5414-43eb-813d-412d718e0e58 => generated 354 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:01:00.884748 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-6e0260b4-d835-4a8d-8da2-ac27a1ade09b tempest-VolumesGetTestJSON-1228188400 tempest-VolumesGetTestJSON-1228188400-project] Calling method '.version_select at 0x7f030b96e550>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:01.387591 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-5cf8c8d2-523a-4335-b5f2-317e52716612 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.580110 Jun 24 10:01:01.394734 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 4/8] 10.222.0.26 () {60 vars in 1161 bytes} [Fri Jun 24 10:01:00 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:01.402691 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-0cbd6494-4167-4f03-be9a-43ee7fda7156 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] Calling method '.version_select at 0x7f030b977280>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:01.529074 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-6e0260b4-d835-4a8d-8da2-ac27a1ade09b tempest-VolumesGetTestJSON-1228188400 tempest-VolumesGetTestJSON-1228188400-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/51e613e2-5414-43eb-813d-412d718e0e58" status: 200 len: 354 microversion: 2.1 time: 0.648982 Jun 24 10:01:01.529920 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 5/9] 10.222.0.26 () {58 vars in 1244 bytes} [Fri Jun 24 10:01:00 2022] GET /compute/v2.1/os-volumes/51e613e2-5414-43eb-813d-412d718e0e58 => generated 354 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:01.549178 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-05da7901-9065-431f-9d97-b6ba86fe45d0 tempest-VolumesGetTestJSON-1228188400 tempest-VolumesGetTestJSON-1228188400-project] Calling method '.version_select at 0x7f030b95dd30>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:01.953625 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-0cbd6494-4167-4f03-be9a-43ee7fda7156 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/92ff176c-7c0a-4a6e-a25e-92fbe9470e40" status: 200 len: 285 microversion: 2.1 time: 0.556884 Jun 24 10:01:01.966497 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 5/10] 10.222.0.26 () {58 vars in 1250 bytes} [Fri Jun 24 10:01:01 2022] GET /compute/v2.1/os-snapshots/92ff176c-7c0a-4a6e-a25e-92fbe9470e40 => generated 285 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:01.966899 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-4e145ba9-8a57-4a45-98e7-e4aa58d149ca tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] Calling method '.version_select at 0x7f030b977940>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:02.035156 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-05da7901-9065-431f-9d97-b6ba86fe45d0 tempest-VolumesGetTestJSON-1228188400 tempest-VolumesGetTestJSON-1228188400-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/51e613e2-5414-43eb-813d-412d718e0e58" status: 202 len: 0 microversion: 2.1 time: 0.491751 Jun 24 10:01:02.038790 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 6/11] 10.222.0.26 () {58 vars in 1247 bytes} [Fri Jun 24 10:01:01 2022] DELETE /compute/v2.1/os-volumes/51e613e2-5414-43eb-813d-412d718e0e58 => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:01:02.044158 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-5b34309c-80e8-428d-9b93-06714fa85459 tempest-VolumesGetTestJSON-1228188400 tempest-VolumesGetTestJSON-1228188400-project] Calling method '.version_select at 0x7f030b95db80>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:02.130399 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-4e145ba9-8a57-4a45-98e7-e4aa58d149ca tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.168259 Jun 24 10:01:02.131009 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1139 bytes} [Fri Jun 24 10:01:01 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:02.144934 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-f0fff33e-724e-4906-b893-1f7c37607ce2 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] Calling method '.version_select at 0x7f030b977d30>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:02.230324 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-5b34309c-80e8-428d-9b93-06714fa85459 tempest-VolumesGetTestJSON-1228188400 tempest-VolumesGetTestJSON-1228188400-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/51e613e2-5414-43eb-813d-412d718e0e58" status: 200 len: 353 microversion: 2.1 time: 0.188245 Jun 24 10:01:02.230324 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1244 bytes} [Fri Jun 24 10:01:02 2022] GET /compute/v2.1/os-volumes/51e613e2-5414-43eb-813d-412d718e0e58 => generated 353 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:02.270786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-f0fff33e-724e-4906-b893-1f7c37607ce2 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/92ff176c-7c0a-4a6e-a25e-92fbe9470e40" status: 200 len: 285 microversion: 2.1 time: 0.132428 Jun 24 10:01:02.273215 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 7/14] 10.222.0.26 () {58 vars in 1250 bytes} [Fri Jun 24 10:01:02 2022] GET /compute/v2.1/os-snapshots/92ff176c-7c0a-4a6e-a25e-92fbe9470e40 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:03.253499 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-5dd4ca9c-02fd-428b-97ca-e8eb64527f99 tempest-VolumesGetTestJSON-1228188400 tempest-VolumesGetTestJSON-1228188400-project] Calling method '.version_select at 0x7f030b96e700>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:03.284771 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-f5eb4ccc-9da0-457a-85d9-227dd9d341e0 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] Calling method '.version_select at 0x7f030b9774c0>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:03.341344 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-f5eb4ccc-9da0-457a-85d9-227dd9d341e0 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/92ff176c-7c0a-4a6e-a25e-92fbe9470e40" status: 200 len: 285 microversion: 2.1 time: 0.060845 Jun 24 10:01:03.342418 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 8/15] 10.222.0.26 () {58 vars in 1250 bytes} [Fri Jun 24 10:01:03 2022] GET /compute/v2.1/os-snapshots/92ff176c-7c0a-4a6e-a25e-92fbe9470e40 => generated 285 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:03.355575 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-5dd4ca9c-02fd-428b-97ca-e8eb64527f99 tempest-VolumesGetTestJSON-1228188400 tempest-VolumesGetTestJSON-1228188400-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/51e613e2-5414-43eb-813d-412d718e0e58" status: 200 len: 353 microversion: 2.1 time: 0.117225 Jun 24 10:01:03.356537 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1244 bytes} [Fri Jun 24 10:01:03 2022] GET /compute/v2.1/os-volumes/51e613e2-5414-43eb-813d-412d718e0e58 => generated 353 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:04.355728 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-b67ee0bc-ec55-4244-a0cc-72585992829b tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] Calling method '.version_select at 0x7f030b95e4c0>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:04.367569 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-5a47cca2-54fe-4296-80ac-fdf7e496903e tempest-VolumesGetTestJSON-1228188400 tempest-VolumesGetTestJSON-1228188400-project] Calling method '.version_select at 0x7f030b95d940>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:04.428793 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-b67ee0bc-ec55-4244-a0cc-72585992829b tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/92ff176c-7c0a-4a6e-a25e-92fbe9470e40" status: 200 len: 285 microversion: 2.1 time: 0.078980 Jun 24 10:01:04.429705 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 9/17] 10.222.0.26 () {58 vars in 1250 bytes} [Fri Jun 24 10:01:04 2022] GET /compute/v2.1/os-snapshots/92ff176c-7c0a-4a6e-a25e-92fbe9470e40 => generated 285 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:01:04.505568 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-5a47cca2-54fe-4296-80ac-fdf7e496903e tempest-VolumesGetTestJSON-1228188400 tempest-VolumesGetTestJSON-1228188400-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/51e613e2-5414-43eb-813d-412d718e0e58" status: 200 len: 353 microversion: 2.1 time: 0.141510 Jun 24 10:01:04.506868 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 9/18] 10.222.0.26 () {58 vars in 1244 bytes} [Fri Jun 24 10:01:04 2022] GET /compute/v2.1/os-volumes/51e613e2-5414-43eb-813d-412d718e0e58 => generated 353 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:05.442047 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-b7402cd4-2b08-4714-b803-7da9bf573682 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] Calling method '.version_select at 0x7f030b977310>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:05.519138 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-8ffd1a22-dea3-453a-a463-b1767169b43d tempest-VolumesGetTestJSON-1228188400 tempest-VolumesGetTestJSON-1228188400-project] Calling method '.version_select at 0x7f030b95ddc0>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:05.522531 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-b7402cd4-2b08-4714-b803-7da9bf573682 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/92ff176c-7c0a-4a6e-a25e-92fbe9470e40" status: 200 len: 286 microversion: 2.1 time: 0.084927 Jun 24 10:01:05.523090 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 10/19] 10.222.0.26 () {58 vars in 1250 bytes} [Fri Jun 24 10:01:05 2022] GET /compute/v2.1/os-snapshots/92ff176c-7c0a-4a6e-a25e-92fbe9470e40 => generated 286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:05.535724 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-fe82d63e-4f7d-4dac-ae52-3233dde085a4 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] Calling method '.version_select at 0x7f030b977af0>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:05.686490 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-8ffd1a22-dea3-453a-a463-b1767169b43d tempest-VolumesGetTestJSON-1228188400 tempest-VolumesGetTestJSON-1228188400-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/51e613e2-5414-43eb-813d-412d718e0e58" status: 200 len: 353 microversion: 2.1 time: 0.171256 Jun 24 10:01:05.687528 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 10/20] 10.222.0.26 () {58 vars in 1244 bytes} [Fri Jun 24 10:01:05 2022] GET /compute/v2.1/os-volumes/51e613e2-5414-43eb-813d-412d718e0e58 => generated 353 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:01:05.847323 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-fe82d63e-4f7d-4dac-ae52-3233dde085a4 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/92ff176c-7c0a-4a6e-a25e-92fbe9470e40" status: 202 len: 0 microversion: 2.1 time: 0.317045 Jun 24 10:01:05.849690 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 11/21] 10.222.0.26 () {58 vars in 1253 bytes} [Fri Jun 24 10:01:05 2022] DELETE /compute/v2.1/os-snapshots/92ff176c-7c0a-4a6e-a25e-92fbe9470e40 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:01:05.861074 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-ab231ca8-b5de-4404-9b6f-dc14adb602a4 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] Calling method '.version_select at 0x7f030b96e4c0>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:05.945210 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-ab231ca8-b5de-4404-9b6f-dc14adb602a4 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/92ff176c-7c0a-4a6e-a25e-92fbe9470e40" status: 200 len: 285 microversion: 2.1 time: 0.090227 Jun 24 10:01:05.945811 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 11/22] 10.222.0.26 () {58 vars in 1250 bytes} [Fri Jun 24 10:01:05 2022] GET /compute/v2.1/os-snapshots/92ff176c-7c0a-4a6e-a25e-92fbe9470e40 => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:06.058351 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-f6481efc-c1df-4c99-8dfe-cfaee7f5694f tempest-VolumesTestJSON-883318951 tempest-VolumesTestJSON-883318951-project] Calling method '.version_select at 0x7f030b95eca0>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:06.130130 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-f6481efc-c1df-4c99-8dfe-cfaee7f5694f tempest-VolumesTestJSON-883318951 tempest-VolumesTestJSON-883318951-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/d924a3a2-d615-4935-a5a4-31965380089c" status: 200 len: 350 microversion: 2.1 time: 0.076949 Jun 24 10:01:06.131797 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 12/23] 10.222.0.26 () {58 vars in 1244 bytes} [Fri Jun 24 10:01:06 2022] GET /compute/v2.1/os-volumes/d924a3a2-d615-4935-a5a4-31965380089c => generated 350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:06.699828 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-507577b8-bad0-4455-b78f-9739ecd1271d tempest-VolumesGetTestJSON-1228188400 tempest-VolumesGetTestJSON-1228188400-project] Calling method '.version_select at 0x7f030b96e550>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:06.744790 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-507577b8-bad0-4455-b78f-9739ecd1271d tempest-VolumesGetTestJSON-1228188400 tempest-VolumesGetTestJSON-1228188400-project] HTTP exception thrown: Volume 51e613e2-5414-43eb-813d-412d718e0e58 could not be found. Jun 24 10:01:06.750411 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-507577b8-bad0-4455-b78f-9739ecd1271d tempest-VolumesGetTestJSON-1228188400 tempest-VolumesGetTestJSON-1228188400-project] Request method failure captured: Jun 24 10:01:06.750411 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: GET /compute/v2.1/os-volumes/51e613e2-5414-43eb-813d-412d718e0e58 HTTP/1.1 Jun 24 10:01:06.750411 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:01:06.750411 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:01:06.750411 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:01:06.750411 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 0 Jun 24 10:01:06.750411 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:01:06.750411 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:01:06.750411 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:01:06.750411 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:01:06.750411 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitYtYrvsrsVNF4SWCYZmAJbyRumL3t7n1GqFDv5Yo8fPsI0JOoiLJV8n-Bt5wmmPZdPQjjtQTWQjYdrUk_U-okXvDHI1NqBkhGGx91FLKH_eVKPuQ6EKddqpZa0_R3vflSKqGtzAE3kCT-qBdS4RtXfr-bTUceskbTsjR4MLxH8M7mCY Jun 24 10:01:06.750411 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:01:06.750411 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:01:06.750411 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:01:06.750411 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:01:06.750411 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:01:06.750411 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:01:06.750411 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: 9112cc44dad346738c92c2887c1af64c Jun 24 10:01:06.750411 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-VolumesGetTestJSON-1228188400 Jun 24 10:01:06.750411 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:01:06.750411 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:01:06.751628 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9112cc44dad346738c92c2887c1af64c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9112cc44dad346738c92c2887c1af64c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9112cc44dad346738c92c2887c1af64c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9112cc44dad346738c92c2887c1af64c"}]}] Jun 24 10:01:06.751628 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-VolumesGetTestJSON-1228188400 Jun 24 10:01:06.751628 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: 9112cc44dad346738c92c2887c1af64c Jun 24 10:01:06.751628 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-VolumesGetTestJSON-1228188400 Jun 24 10:01:06.751628 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-VolumesGetTestJSON-1228188400-project Jun 24 10:01:06.751628 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:01:06.751628 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:01:06.751628 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: 9371387bd5744152a6b9489093f4c38b Jun 24 10:01:06.751628 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-VolumesGetTestJSON-1228188400-project Jun 24 10:01:06.751628 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: Jun 24 10:01:06.751628 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Volume 51e613e2-5414-43eb-813d-412d718e0e58 could not be found. Jun 24 10:01:06.751628 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'id': '51e613e2-5414-43eb-813d-412d718e0e58'} Jun 24 10:01:06.751628 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:01:06.752496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:06.752496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:01:06.752496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:01:06.752496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 10:01:06.752496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 10:01:06.752496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 10:01:06.752496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 10:01:06.752496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 10:01:06.752496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 10:01:06.752496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 10:01:06.752496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 10:01:06.752496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:01:06.752496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:01:06.752496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:01:06.752496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:01:06.752496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 51e613e2-5414-43eb-813d-412d718e0e58 could not be found. (HTTP 404) (Request-ID: req-5635277d-e09f-48d0-82a3-7e23cc6f220a) Jun 24 10:01:06.752496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:06.752496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:01:06.752496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:06.756180 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:06.756180 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 10:01:06.756180 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 10:01:06.756180 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 10:01:06.756180 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 10:01:06.756180 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 10:01:06.756180 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 10:01:06.756180 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 10:01:06.756180 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 10:01:06.756180 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:01:06.756180 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:01:06.756180 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 10:01:06.756180 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 10:01:06.756180 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 10:01:06.756180 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 10:01:06.756180 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 10:01:06.756180 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 10:01:06.756180 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 10:01:06.756180 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 10:01:06.757414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:01:06.757414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:01:06.757414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:01:06.757414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:01:06.757414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 51e613e2-5414-43eb-813d-412d718e0e58 could not be found. Jun 24 10:01:06.757414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:06.757414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:01:06.757414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:06.757414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:06.757414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:01:06.757414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:01:06.757414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:01:06.757414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:01:06.757414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:01:06.757414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:01:06.757414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:01:06.757414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:01:06.757414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 10:01:06.757414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:01:06.758541 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 51e613e2-5414-43eb-813d-412d718e0e58 could not be found. Jun 24 10:01:06.758541 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:06.758541 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:01:06.758541 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:06.758541 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:06.758541 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:01:06.758541 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:01:06.758541 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:01:06.758541 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:01:06.758541 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 51e613e2-5414-43eb-813d-412d718e0e58 could not be found. Jun 24 10:01:06.758541 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:06.758541 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-507577b8-bad0-4455-b78f-9739ecd1271d tempest-VolumesGetTestJSON-1228188400 tempest-VolumesGetTestJSON-1228188400-project] Returning 404 to user: Volume 51e613e2-5414-43eb-813d-412d718e0e58 could not be found. {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:01:06.758541 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-507577b8-bad0-4455-b78f-9739ecd1271d tempest-VolumesGetTestJSON-1228188400 tempest-VolumesGetTestJSON-1228188400-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/51e613e2-5414-43eb-813d-412d718e0e58" status: 404 len: 109 microversion: 2.1 time: 0.059371 Jun 24 10:01:06.758541 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 12/24] 10.222.0.26 () {58 vars in 1244 bytes} [Fri Jun 24 10:01:06 2022] GET /compute/v2.1/os-volumes/51e613e2-5414-43eb-813d-412d718e0e58 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:01:06.959728 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-7a972148-088d-47b8-9f3d-09d625ecd8f7 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] Calling method '.version_select at 0x7f030b95e670>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:07.170695 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.wsgi [None req-7a972148-088d-47b8-9f3d-09d625ecd8f7 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] HTTP exception thrown: Snapshot 92ff176c-7c0a-4a6e-a25e-92fbe9470e40 could not be found. Jun 24 10:01:07.176888 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-7a972148-088d-47b8-9f3d-09d625ecd8f7 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] Request method failure captured: Jun 24 10:01:07.176888 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: request: GET /compute/v2.1/os-snapshots/92ff176c-7c0a-4a6e-a25e-92fbe9470e40 HTTP/1.1 Jun 24 10:01:07.176888 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept: application/json Jun 24 10:01:07.176888 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept-Encoding: identity Jun 24 10:01:07.176888 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Connection: close Jun 24 10:01:07.176888 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Length: 0 Jun 24 10:01:07.176888 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Type: application/json Jun 24 10:01:07.176888 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Host: 10.222.0.26 Jun 24 10:01:07.176888 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Openstack-System-Scope: None Jun 24 10:01:07.176888 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: User-Agent: python-urllib3/1.26.9 Jun 24 10:01:07.176888 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Auth-Token: gAAAAABitYtY2eCLS1eH-P__7HbBXamAVm0VIE8uBvu3lnS8MCCW2OEPn-TPVdtT5M_a1mZaq0ZQeKTmKjfGSVevzsFf1aFNKF7loc5BKar8yzKAv5vbJVIHlSN-nLrkVhTZ_v1MU4_L865is20UxJDxaHpwmi2llEvhcvefp7A1d7_dr6TJGcM Jun 24 10:01:07.176888 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Id: None Jun 24 10:01:07.176888 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Name: None Jun 24 10:01:07.176888 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Identity-Status: Confirmed Jun 24 10:01:07.176888 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Is-Admin-Project: True Jun 24 10:01:07.176888 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Id: default Jun 24 10:01:07.176888 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Name: Default Jun 24 10:01:07.176888 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Id: 21f9c0bcecd44feea1ecc7922d55b13a Jun 24 10:01:07.176888 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-98867598 Jun 24 10:01:07.176888 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Role: reader,member Jun 24 10:01:07.176888 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Roles: reader,member Jun 24 10:01:07.178278 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/21f9c0bcecd44feea1ecc7922d55b13a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_21f9c0bcecd44feea1ecc7922d55b13a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/21f9c0bcecd44feea1ecc7922d55b13a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/21f9c0bcecd44feea1ecc7922d55b13a"}]}] Jun 24 10:01:07.178278 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant: tempest-VolumesSnapshotsTestJSON-98867598 Jun 24 10:01:07.178278 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Id: 21f9c0bcecd44feea1ecc7922d55b13a Jun 24 10:01:07.178278 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-98867598 Jun 24 10:01:07.178278 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User: tempest-VolumesSnapshotsTestJSON-98867598-project Jun 24 10:01:07.178278 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Id: default Jun 24 10:01:07.178278 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Name: Default Jun 24 10:01:07.178278 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Id: 2bd022a699734339a99854a20c869cc5 Jun 24 10:01:07.178278 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Name: tempest-VolumesSnapshotsTestJSON-98867598-project Jun 24 10:01:07.178278 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: method: Jun 24 10:01:07.178278 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: exception: Snapshot 92ff176c-7c0a-4a6e-a25e-92fbe9470e40 could not be found. Jun 24 10:01:07.178278 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: action_args: {'id': '92ff176c-7c0a-4a6e-a25e-92fbe9470e40'} Jun 24 10:01:07.178278 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:01:07.179087 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:07.179087 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 24 10:01:07.179087 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 24 10:01:07.179087 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 24 10:01:07.179087 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 24 10:01:07.179087 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 24 10:01:07.179087 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 24 10:01:07.179087 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 10:01:07.179087 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 10:01:07.179087 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 10:01:07.179087 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 10:01:07.179087 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:01:07.179087 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:01:07.179087 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:01:07.179087 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:01:07.179087 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 92ff176c-7c0a-4a6e-a25e-92fbe9470e40 could not be found. (HTTP 404) (Request-ID: req-2ddcb586-d61e-4d5c-8d83-2da20c717059) Jun 24 10:01:07.179087 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:01:07.179087 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:01:07.179968 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:01:07.179968 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:07.179968 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 24 10:01:07.179968 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 24 10:01:07.179968 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 10:01:07.179968 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 10:01:07.179968 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 24 10:01:07.179968 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 24 10:01:07.179968 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 10:01:07.179968 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 10:01:07.179968 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 24 10:01:07.179968 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 24 10:01:07.179968 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 24 10:01:07.179968 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 24 10:01:07.179968 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 24 10:01:07.179968 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 24 10:01:07.179968 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 10:01:07.179968 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 10:01:07.179968 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 10:01:07.182064 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 10:01:07.182064 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:01:07.182064 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:01:07.182064 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:01:07.182064 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:01:07.182064 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 92ff176c-7c0a-4a6e-a25e-92fbe9470e40 could not be found. Jun 24 10:01:07.182064 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:01:07.182064 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:01:07.182064 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:01:07.182064 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:07.182064 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:01:07.182064 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:01:07.182064 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:01:07.182064 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:01:07.182064 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:01:07.182064 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:01:07.182064 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:01:07.182064 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:01:07.182064 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 24 10:01:07.182064 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:01:07.184033 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 92ff176c-7c0a-4a6e-a25e-92fbe9470e40 could not be found. Jun 24 10:01:07.184033 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:01:07.184033 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:01:07.184033 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:01:07.184033 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:07.184033 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:01:07.184033 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:01:07.184033 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:01:07.184033 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:01:07.184033 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 92ff176c-7c0a-4a6e-a25e-92fbe9470e40 could not be found. Jun 24 10:01:07.184033 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:01:07.184033 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-7a972148-088d-47b8-9f3d-09d625ecd8f7 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] Returning 404 to user: Snapshot 92ff176c-7c0a-4a6e-a25e-92fbe9470e40 could not be found. {{(pid=124980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:01:07.184033 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-7a972148-088d-47b8-9f3d-09d625ecd8f7 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/92ff176c-7c0a-4a6e-a25e-92fbe9470e40" status: 404 len: 111 microversion: 2.1 time: 0.223423 Jun 24 10:01:07.184033 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 13/25] 10.222.0.26 () {58 vars in 1250 bytes} [Fri Jun 24 10:01:06 2022] GET /compute/v2.1/os-snapshots/92ff176c-7c0a-4a6e-a25e-92fbe9470e40 => generated 111 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:01:07.193780 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-46dc4b6c-c08e-45b3-9d66-0f7d7fbd79ae tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] Calling method '.version_select at 0x7f030b96eb80>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:07.606378 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-46dc4b6c-c08e-45b3-9d66-0f7d7fbd79ae tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/174378d9-26d1-4740-8e71-f6d101b02b09" status: 202 len: 0 microversion: 2.1 time: 0.422122 Jun 24 10:01:07.610615 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 13/26] 10.222.0.26 () {58 vars in 1247 bytes} [Fri Jun 24 10:01:07 2022] DELETE /compute/v2.1/os-volumes/174378d9-26d1-4740-8e71-f6d101b02b09 => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:01:07.633518 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-eb2200a1-d848-4ed1-b61f-214a9c831db2 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] Calling method '.version_select at 0x7f030b96e4c0>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:07.782604 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-eb2200a1-d848-4ed1-b61f-214a9c831db2 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/174378d9-26d1-4740-8e71-f6d101b02b09" status: 200 len: 345 microversion: 2.1 time: 0.161736 Jun 24 10:01:07.784070 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 14/27] 10.222.0.26 () {58 vars in 1244 bytes} [Fri Jun 24 10:01:07 2022] GET /compute/v2.1/os-volumes/174378d9-26d1-4740-8e71-f6d101b02b09 => generated 345 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:07.971439 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-9a481063-11ec-4c95-bb86-1a541d33f2df tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Action: 'create', calling method: .version_select at 0x7f030b95ee50>, body: {"keypair": {"name": "tempest-keypair-541898312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJoxfSSMn3/uAD/dvMX9Nyi6LiqIh/dirII5Y2pB6ZW5eMJeUK3If+0OTpH6eC2DmPpeswFSNCu2syDHfBM9sDefwu9EwRuQxdTHO7hrgRou/1jXyR3k7KkPtrncrTEumA=="}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:01:08.046507 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-9a481063-11ec-4c95-bb86-1a541d33f2df tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Getting quotas for project a77797eae68a42639f886f64db5f5598. Resources: {'key_pairs'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:01:08.069477 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-9a481063-11ec-4c95-bb86-1a541d33f2df tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Getting quotas for user cd894c323c604ed593a01d17092e6c2a and project a77797eae68a42639f886f64db5f5598. Resources: {'key_pairs'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:01:08.237748 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-9a481063-11ec-4c95-bb86-1a541d33f2df tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.739081 Jun 24 10:01:08.239204 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 14/28] 10.222.0.26 () {62 vars in 1199 bytes} [Fri Jun 24 10:01:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 741 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 24 10:01:08.309552 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-3ca9d7ea-a415-49a9-b913-d089bceeb180 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Action: 'create', calling method: .version_select at 0x7f030b9ca040>, body: {"keypair": {"name": "tempest-keypair-170224298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjUFAbYhva9sEkriOWUFYYIx3M1Y8dWQLtZYnQwCxIo/iW81iclUcXdOSVH3N4F3kCCl01nv6eQNe2XXTOj1meiXTsrDzdhrehbbcdjpe2vLR1KP+NlhrQ74hZ5aB6Frg=="}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:01:08.435282 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-90381e42-f123-4e13-a6a3-978634e7a98d tempest-VolumesTestJSON-883318951 tempest-VolumesTestJSON-883318951-project] Calling method '.version_select at 0x7f030b8a8dc0>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:08.461325 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-3ca9d7ea-a415-49a9-b913-d089bceeb180 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Getting quotas for project b57a965c8ac24ad383260d621813bc3b. Resources: {'key_pairs'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:01:08.470370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-3ca9d7ea-a415-49a9-b913-d089bceeb180 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Getting quotas for user b9d6654cd5c54c0294cbe1e2a1204c76 and project b57a965c8ac24ad383260d621813bc3b. Resources: {'key_pairs'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:01:08.594884 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-90381e42-f123-4e13-a6a3-978634e7a98d tempest-VolumesTestJSON-883318951 tempest-VolumesTestJSON-883318951-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/1da2f575-3368-4683-8ffb-cdd23f5d2b7c" status: 200 len: 350 microversion: 2.1 time: 0.168659 Jun 24 10:01:08.606027 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 15/29] 10.222.0.26 () {58 vars in 1244 bytes} [Fri Jun 24 10:01:08 2022] GET /compute/v2.1/os-volumes/1da2f575-3368-4683-8ffb-cdd23f5d2b7c => generated 350 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:08.610088 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-99108d01-c792-4d33-bd03-9f8c36764138 tempest-VolumesTestJSON-883318951 tempest-VolumesTestJSON-883318951-project] Calling method '.version_select at 0x7f030b863430>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:08.664331 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-3ca9d7ea-a415-49a9-b913-d089bceeb180 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.451238 Jun 24 10:01:08.665591 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 15/30] 10.222.0.26 () {60 vars in 1158 bytes} [Fri Jun 24 10:01:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:01:08.801852 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-b7b21558-008b-409d-831c-06d797696f03 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] Calling method '.version_select at 0x7f030b8b25e0>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:08.859732 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-99108d01-c792-4d33-bd03-9f8c36764138 tempest-VolumesTestJSON-883318951 tempest-VolumesTestJSON-883318951-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.253692 Jun 24 10:01:08.869083 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 16/31] 10.222.0.26 () {58 vars in 1133 bytes} [Fri Jun 24 10:01:08 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:08.886102 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-483772ba-dd9a-48c7-8929-3ce720340627 tempest-VolumesTestJSON-883318951 tempest-VolumesTestJSON-883318951-project] Calling method '.version_select at 0x7f030b863ee0>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:08.920372 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-b7b21558-008b-409d-831c-06d797696f03 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/174378d9-26d1-4740-8e71-f6d101b02b09" status: 200 len: 345 microversion: 2.1 time: 0.124814 Jun 24 10:01:08.920950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 16/32] 10.222.0.26 () {58 vars in 1244 bytes} [Fri Jun 24 10:01:08 2022] GET /compute/v2.1/os-volumes/174378d9-26d1-4740-8e71-f6d101b02b09 => generated 345 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:09.126181 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-483772ba-dd9a-48c7-8929-3ce720340627 tempest-VolumesTestJSON-883318951 tempest-VolumesTestJSON-883318951-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.255857 Jun 24 10:01:09.128041 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 17/33] 10.222.0.26 () {58 vars in 1148 bytes} [Fri Jun 24 10:01:08 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:09.153734 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-7ef76be3-1f5b-456c-9a94-65ae4f5cbbde tempest-VolumesTestJSON-883318951 tempest-VolumesTestJSON-883318951-project] Calling method '.version_select at 0x7f030b86b310>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:09.315673 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-7ef76be3-1f5b-456c-9a94-65ae4f5cbbde tempest-VolumesTestJSON-883318951 tempest-VolumesTestJSON-883318951-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.177970 Jun 24 10:01:09.316450 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 17/34] 10.222.0.26 () {58 vars in 1133 bytes} [Fri Jun 24 10:01:09 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:01:09.329683 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-1518f528-832a-4617-a4be-44a75fe72ee7 tempest-VolumesTestJSON-883318951 tempest-VolumesTestJSON-883318951-project] Calling method '.version_select at 0x7f030b863b80>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:09.549108 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-1518f528-832a-4617-a4be-44a75fe72ee7 tempest-VolumesTestJSON-883318951 tempest-VolumesTestJSON-883318951-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.223182 Jun 24 10:01:09.567320 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-1ac45011-0f18-4a0f-9570-826766ca545e tempest-VolumesTestJSON-883318951 tempest-VolumesTestJSON-883318951-project] Calling method '.version_select at 0x7f030b86bf70>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:09.568261 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 18/35] 10.222.0.26 () {58 vars in 1166 bytes} [Fri Jun 24 10:01:09 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:09.721078 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-1ac45011-0f18-4a0f-9570-826766ca545e tempest-VolumesTestJSON-883318951 tempest-VolumesTestJSON-883318951-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.161955 Jun 24 10:01:09.721901 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 18/36] 10.222.0.26 () {58 vars in 1169 bytes} [Fri Jun 24 10:01:09 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:09.737031 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-b8ad7568-6c90-49e4-8890-413092e70cf6 tempest-VolumesTestJSON-883318951 tempest-VolumesTestJSON-883318951-project] Calling method '.version_select at 0x7f030b95ec10>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:09.919953 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-b8ad7568-6c90-49e4-8890-413092e70cf6 tempest-VolumesTestJSON-883318951 tempest-VolumesTestJSON-883318951-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.188503 Jun 24 10:01:09.937346 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-43a9524e-3a2f-4569-9334-42dd70a842fe tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] Calling method '.version_select at 0x7f030b86bb80>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:09.947554 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 19/37] 10.222.0.26 () {58 vars in 1154 bytes} [Fri Jun 24 10:01:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:09.948334 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-ef97424e-d180-4628-8f34-d4cbcedaccf6 tempest-VolumesTestJSON-883318951 tempest-VolumesTestJSON-883318951-project] Calling method '.version_select at 0x7f030b875280>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:10.080281 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-43a9524e-3a2f-4569-9334-42dd70a842fe tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/174378d9-26d1-4740-8e71-f6d101b02b09" status: 200 len: 345 microversion: 2.1 time: 0.146715 Jun 24 10:01:10.087511 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 19/38] 10.222.0.26 () {58 vars in 1244 bytes} [Fri Jun 24 10:01:09 2022] GET /compute/v2.1/os-volumes/174378d9-26d1-4740-8e71-f6d101b02b09 => generated 345 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:10.128451 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-ef97424e-d180-4628-8f34-d4cbcedaccf6 tempest-VolumesTestJSON-883318951 tempest-VolumesTestJSON-883318951-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.189465 Jun 24 10:01:10.163288 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 20/39] 10.222.0.26 () {58 vars in 1187 bytes} [Fri Jun 24 10:01:09 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:10.163433 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-9f98d75e-2dc2-4e87-9641-a970e50fdabd tempest-VolumesTestJSON-883318951 tempest-VolumesTestJSON-883318951-project] Calling method '.version_select at 0x7f030b86b670>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:10.287321 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-9f98d75e-2dc2-4e87-9641-a970e50fdabd tempest-VolumesTestJSON-883318951 tempest-VolumesTestJSON-883318951-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.135569 Jun 24 10:01:10.302800 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 20/40] 10.222.0.26 () {58 vars in 1154 bytes} [Fri Jun 24 10:01:10 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:11.093716 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-914ed741-422d-45db-aab5-9c85a43d05f6 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] Calling method '.version_select at 0x7f030b8b2790>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:11.207837 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-914ed741-422d-45db-aab5-9c85a43d05f6 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/174378d9-26d1-4740-8e71-f6d101b02b09" status: 200 len: 345 microversion: 2.1 time: 0.117927 Jun 24 10:01:11.216253 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 21/41] 10.222.0.26 () {58 vars in 1244 bytes} [Fri Jun 24 10:01:11 2022] GET /compute/v2.1/os-volumes/174378d9-26d1-4740-8e71-f6d101b02b09 => generated 345 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:01:11.301035 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-47bf5320-77cf-49df-89fd-3b2f7623d384 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-944903308", "imageRef": "f6b1dddb-2953-41a2-99e3-00aeca441bd9", "flavorRef": "452", "networks": [{"uuid": "9d3516bf-89dd-46de-b07c-0627a924af1f"}]}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:01:11.492373 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.network.neutron [None req-47bf5320-77cf-49df-89fd-3b2f7623d384 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] validate_networks() for [('9d3516bf-89dd-46de-b07c-0627a924af1f', None, None, None, None, None)] {{(pid=124980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:01:12.221060 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-cf775af2-2045-4754-822d-5879f25c1d92 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] Calling method '.version_select at 0x7f030b8b2550>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:12.283116 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-cf775af2-2045-4754-822d-5879f25c1d92 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] HTTP exception thrown: Volume 174378d9-26d1-4740-8e71-f6d101b02b09 could not be found. Jun 24 10:01:12.285461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-cf775af2-2045-4754-822d-5879f25c1d92 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] Request method failure captured: Jun 24 10:01:12.285461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: GET /compute/v2.1/os-volumes/174378d9-26d1-4740-8e71-f6d101b02b09 HTTP/1.1 Jun 24 10:01:12.285461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:01:12.285461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:01:12.285461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:01:12.285461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 0 Jun 24 10:01:12.285461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:01:12.285461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:01:12.285461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:01:12.285461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:01:12.285461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitYtY2eCLS1eH-P__7HbBXamAVm0VIE8uBvu3lnS8MCCW2OEPn-TPVdtT5M_a1mZaq0ZQeKTmKjfGSVevzsFf1aFNKF7loc5BKar8yzKAv5vbJVIHlSN-nLrkVhTZ_v1MU4_L865is20UxJDxaHpwmi2llEvhcvefp7A1d7_dr6TJGcM Jun 24 10:01:12.285461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:01:12.285461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:01:12.285461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:01:12.285461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:01:12.285461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:01:12.285461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:01:12.285461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: 21f9c0bcecd44feea1ecc7922d55b13a Jun 24 10:01:12.285461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-98867598 Jun 24 10:01:12.285461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:01:12.285461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:01:12.286562 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/21f9c0bcecd44feea1ecc7922d55b13a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_21f9c0bcecd44feea1ecc7922d55b13a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/21f9c0bcecd44feea1ecc7922d55b13a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/21f9c0bcecd44feea1ecc7922d55b13a"}]}] Jun 24 10:01:12.286562 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-VolumesSnapshotsTestJSON-98867598 Jun 24 10:01:12.286562 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: 21f9c0bcecd44feea1ecc7922d55b13a Jun 24 10:01:12.286562 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-98867598 Jun 24 10:01:12.286562 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-VolumesSnapshotsTestJSON-98867598-project Jun 24 10:01:12.286562 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:01:12.286562 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:01:12.286562 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: 2bd022a699734339a99854a20c869cc5 Jun 24 10:01:12.286562 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-VolumesSnapshotsTestJSON-98867598-project Jun 24 10:01:12.286562 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: Jun 24 10:01:12.286562 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Volume 174378d9-26d1-4740-8e71-f6d101b02b09 could not be found. Jun 24 10:01:12.286562 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'id': '174378d9-26d1-4740-8e71-f6d101b02b09'} Jun 24 10:01:12.286562 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:01:12.287237 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:12.287237 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:01:12.287237 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:01:12.287237 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 10:01:12.287237 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 10:01:12.287237 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 10:01:12.287237 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 10:01:12.287237 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 10:01:12.287237 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 10:01:12.287237 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 10:01:12.287237 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 10:01:12.287237 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:01:12.287237 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:01:12.287237 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:01:12.287237 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:01:12.287237 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 174378d9-26d1-4740-8e71-f6d101b02b09 could not be found. (HTTP 404) (Request-ID: req-76fc5546-ff7a-4c7a-a85f-a40523ae2bcc) Jun 24 10:01:12.287237 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:12.287237 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:01:12.287237 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:12.288270 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:12.288270 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 10:01:12.288270 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 10:01:12.288270 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 10:01:12.288270 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 10:01:12.288270 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 10:01:12.288270 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 10:01:12.288270 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 10:01:12.288270 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 10:01:12.288270 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:01:12.288270 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:01:12.288270 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 10:01:12.288270 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 10:01:12.288270 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 10:01:12.288270 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 10:01:12.288270 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 10:01:12.288270 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 10:01:12.288270 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 10:01:12.288270 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 10:01:12.289188 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:01:12.289188 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:01:12.289188 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:01:12.289188 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:01:12.289188 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 174378d9-26d1-4740-8e71-f6d101b02b09 could not be found. Jun 24 10:01:12.289188 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:12.289188 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:01:12.289188 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:12.289188 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:12.289188 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:01:12.289188 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:01:12.289188 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:01:12.289188 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:01:12.289188 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:01:12.289188 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:01:12.289188 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:01:12.289188 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:01:12.289188 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 10:01:12.289188 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:01:12.290727 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 174378d9-26d1-4740-8e71-f6d101b02b09 could not be found. Jun 24 10:01:12.290727 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:12.290727 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:01:12.290727 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:12.290727 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:12.290727 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:01:12.290727 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:01:12.290727 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:01:12.290727 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:01:12.290727 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 174378d9-26d1-4740-8e71-f6d101b02b09 could not be found. Jun 24 10:01:12.290727 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:12.293951 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-cf775af2-2045-4754-822d-5879f25c1d92 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] Returning 404 to user: Volume 174378d9-26d1-4740-8e71-f6d101b02b09 could not be found. {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:01:12.295009 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-cf775af2-2045-4754-822d-5879f25c1d92 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/174378d9-26d1-4740-8e71-f6d101b02b09" status: 404 len: 109 microversion: 2.1 time: 0.077954 Jun 24 10:01:12.301315 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 22/42] 10.222.0.26 () {58 vars in 1244 bytes} [Fri Jun 24 10:01:12 2022] GET /compute/v2.1/os-volumes/174378d9-26d1-4740-8e71-f6d101b02b09 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 10:01:12.309259 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-2c26daa3-cf66-4ff8-b589-27ea2baa022b tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] Calling method '.version_select at 0x7f030b86b820>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:12.371486 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-2c26daa3-cf66-4ff8-b589-27ea2baa022b tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] HTTP exception thrown: Volume 174378d9-26d1-4740-8e71-f6d101b02b09 could not be found. Jun 24 10:01:12.373971 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-2c26daa3-cf66-4ff8-b589-27ea2baa022b tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] Request method failure captured: Jun 24 10:01:12.373971 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: DELETE /compute/v2.1/os-volumes/174378d9-26d1-4740-8e71-f6d101b02b09 HTTP/1.1 Jun 24 10:01:12.373971 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:01:12.373971 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:01:12.373971 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:01:12.373971 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 0 Jun 24 10:01:12.373971 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:01:12.373971 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:01:12.373971 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:01:12.373971 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:01:12.373971 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitYtY2eCLS1eH-P__7HbBXamAVm0VIE8uBvu3lnS8MCCW2OEPn-TPVdtT5M_a1mZaq0ZQeKTmKjfGSVevzsFf1aFNKF7loc5BKar8yzKAv5vbJVIHlSN-nLrkVhTZ_v1MU4_L865is20UxJDxaHpwmi2llEvhcvefp7A1d7_dr6TJGcM Jun 24 10:01:12.373971 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:01:12.373971 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:01:12.373971 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:01:12.373971 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:01:12.373971 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:01:12.373971 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:01:12.373971 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: 21f9c0bcecd44feea1ecc7922d55b13a Jun 24 10:01:12.373971 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-98867598 Jun 24 10:01:12.373971 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:01:12.373971 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:01:12.375315 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/21f9c0bcecd44feea1ecc7922d55b13a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_21f9c0bcecd44feea1ecc7922d55b13a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/21f9c0bcecd44feea1ecc7922d55b13a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/21f9c0bcecd44feea1ecc7922d55b13a"}]}] Jun 24 10:01:12.375315 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-VolumesSnapshotsTestJSON-98867598 Jun 24 10:01:12.375315 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: 21f9c0bcecd44feea1ecc7922d55b13a Jun 24 10:01:12.375315 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-98867598 Jun 24 10:01:12.375315 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-VolumesSnapshotsTestJSON-98867598-project Jun 24 10:01:12.375315 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:01:12.375315 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:01:12.375315 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: 2bd022a699734339a99854a20c869cc5 Jun 24 10:01:12.375315 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-VolumesSnapshotsTestJSON-98867598-project Jun 24 10:01:12.375315 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: Jun 24 10:01:12.375315 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Volume 174378d9-26d1-4740-8e71-f6d101b02b09 could not be found. Jun 24 10:01:12.375315 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'id': '174378d9-26d1-4740-8e71-f6d101b02b09'} Jun 24 10:01:12.375315 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:01:12.376153 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:12.376153 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:01:12.376153 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:01:12.376153 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 10:01:12.376153 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 10:01:12.376153 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 10:01:12.376153 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 10:01:12.376153 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 10:01:12.376153 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 10:01:12.376153 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 10:01:12.376153 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 10:01:12.376153 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:01:12.376153 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:01:12.376153 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:01:12.376153 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:01:12.376153 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 174378d9-26d1-4740-8e71-f6d101b02b09 could not be found. (HTTP 404) (Request-ID: req-9e9af15f-dbf2-436b-9c10-14cab60937ae) Jun 24 10:01:12.376153 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:12.376153 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:01:12.376153 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:12.392225 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:12.392225 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 10:01:12.392225 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 10:01:12.392225 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 10:01:12.392225 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 10:01:12.392225 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 10:01:12.392225 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 10:01:12.392225 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 10:01:12.392225 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 10:01:12.392225 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:01:12.392225 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:01:12.392225 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 10:01:12.392225 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 10:01:12.392225 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 10:01:12.392225 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 10:01:12.392225 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 10:01:12.392225 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 10:01:12.392225 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 10:01:12.392225 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 10:01:12.394810 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:01:12.394810 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:01:12.394810 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:01:12.394810 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:01:12.394810 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 174378d9-26d1-4740-8e71-f6d101b02b09 could not be found. Jun 24 10:01:12.394810 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:12.394810 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:01:12.394810 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:12.394810 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:12.394810 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:01:12.394810 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:01:12.394810 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:01:12.394810 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:01:12.394810 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:01:12.394810 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:01:12.394810 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:01:12.394810 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:01:12.394810 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 10:01:12.394810 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:01:12.395953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 174378d9-26d1-4740-8e71-f6d101b02b09 could not be found. Jun 24 10:01:12.395953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:12.395953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:01:12.395953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:12.395953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:12.395953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:01:12.395953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:01:12.395953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:01:12.395953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:01:12.395953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 174378d9-26d1-4740-8e71-f6d101b02b09 could not be found. Jun 24 10:01:12.395953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:12.395953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-2c26daa3-cf66-4ff8-b589-27ea2baa022b tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] Returning 404 to user: Volume 174378d9-26d1-4740-8e71-f6d101b02b09 could not be found. {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:01:12.395953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-2c26daa3-cf66-4ff8-b589-27ea2baa022b tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/174378d9-26d1-4740-8e71-f6d101b02b09" status: 404 len: 109 microversion: 2.1 time: 0.074832 Jun 24 10:01:12.395953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 23/43] 10.222.0.26 () {58 vars in 1247 bytes} [Fri Jun 24 10:01:12 2022] DELETE /compute/v2.1/os-volumes/174378d9-26d1-4740-8e71-f6d101b02b09 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:01:12.402150 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-e1c21909-182f-4bd0-ba82-0b279cee6ba7 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] Calling method '.version_select at 0x7f030b8b2dc0>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:12.445074 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-e1c21909-182f-4bd0-ba82-0b279cee6ba7 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] HTTP exception thrown: Volume 174378d9-26d1-4740-8e71-f6d101b02b09 could not be found. Jun 24 10:01:12.449161 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-e1c21909-182f-4bd0-ba82-0b279cee6ba7 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] Request method failure captured: Jun 24 10:01:12.449161 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: GET /compute/v2.1/os-volumes/174378d9-26d1-4740-8e71-f6d101b02b09 HTTP/1.1 Jun 24 10:01:12.449161 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:01:12.449161 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:01:12.449161 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:01:12.449161 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 0 Jun 24 10:01:12.449161 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:01:12.449161 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:01:12.449161 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:01:12.449161 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:01:12.449161 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitYtY2eCLS1eH-P__7HbBXamAVm0VIE8uBvu3lnS8MCCW2OEPn-TPVdtT5M_a1mZaq0ZQeKTmKjfGSVevzsFf1aFNKF7loc5BKar8yzKAv5vbJVIHlSN-nLrkVhTZ_v1MU4_L865is20UxJDxaHpwmi2llEvhcvefp7A1d7_dr6TJGcM Jun 24 10:01:12.449161 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:01:12.449161 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:01:12.449161 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:01:12.449161 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:01:12.449161 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:01:12.449161 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:01:12.449161 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: 21f9c0bcecd44feea1ecc7922d55b13a Jun 24 10:01:12.449161 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-98867598 Jun 24 10:01:12.449161 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:01:12.449161 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:01:12.450607 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/21f9c0bcecd44feea1ecc7922d55b13a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_21f9c0bcecd44feea1ecc7922d55b13a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/21f9c0bcecd44feea1ecc7922d55b13a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/21f9c0bcecd44feea1ecc7922d55b13a"}]}] Jun 24 10:01:12.450607 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-VolumesSnapshotsTestJSON-98867598 Jun 24 10:01:12.450607 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: 21f9c0bcecd44feea1ecc7922d55b13a Jun 24 10:01:12.450607 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-98867598 Jun 24 10:01:12.450607 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-VolumesSnapshotsTestJSON-98867598-project Jun 24 10:01:12.450607 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:01:12.450607 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:01:12.450607 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: 2bd022a699734339a99854a20c869cc5 Jun 24 10:01:12.450607 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-VolumesSnapshotsTestJSON-98867598-project Jun 24 10:01:12.450607 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: Jun 24 10:01:12.450607 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Volume 174378d9-26d1-4740-8e71-f6d101b02b09 could not be found. Jun 24 10:01:12.450607 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'id': '174378d9-26d1-4740-8e71-f6d101b02b09'} Jun 24 10:01:12.450607 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:01:12.451384 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:12.451384 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:01:12.451384 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:01:12.451384 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 10:01:12.451384 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 10:01:12.451384 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 10:01:12.451384 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 10:01:12.451384 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 10:01:12.451384 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 10:01:12.451384 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 10:01:12.451384 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 10:01:12.451384 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:01:12.451384 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:01:12.451384 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:01:12.451384 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:01:12.451384 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 174378d9-26d1-4740-8e71-f6d101b02b09 could not be found. (HTTP 404) (Request-ID: req-65f7d5d2-ef14-42f2-a545-ccbdfc4cea9f) Jun 24 10:01:12.451384 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:12.451384 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:01:12.451384 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:12.452341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:12.452341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 10:01:12.452341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 10:01:12.452341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 10:01:12.452341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 10:01:12.452341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 10:01:12.452341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 10:01:12.452341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 10:01:12.452341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 10:01:12.452341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:01:12.452341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:01:12.452341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 10:01:12.452341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 10:01:12.452341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 10:01:12.452341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 10:01:12.452341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 10:01:12.452341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 10:01:12.452341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 10:01:12.452341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 10:01:12.453488 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:01:12.453488 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:01:12.453488 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:01:12.453488 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:01:12.453488 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 174378d9-26d1-4740-8e71-f6d101b02b09 could not be found. Jun 24 10:01:12.453488 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:12.453488 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:01:12.453488 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:12.453488 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:12.453488 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:01:12.453488 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:01:12.453488 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:01:12.453488 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:01:12.453488 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:01:12.453488 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:01:12.453488 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:01:12.453488 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:01:12.453488 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 10:01:12.453488 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:01:12.454675 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 174378d9-26d1-4740-8e71-f6d101b02b09 could not be found. Jun 24 10:01:12.454675 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:12.454675 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:01:12.454675 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:12.454675 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:12.454675 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:01:12.454675 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:01:12.454675 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:01:12.454675 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:01:12.454675 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 174378d9-26d1-4740-8e71-f6d101b02b09 could not be found. Jun 24 10:01:12.454675 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:12.454675 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-e1c21909-182f-4bd0-ba82-0b279cee6ba7 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] Returning 404 to user: Volume 174378d9-26d1-4740-8e71-f6d101b02b09 could not be found. {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:01:12.454675 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-e1c21909-182f-4bd0-ba82-0b279cee6ba7 tempest-VolumesSnapshotsTestJSON-98867598 tempest-VolumesSnapshotsTestJSON-98867598-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/174378d9-26d1-4740-8e71-f6d101b02b09" status: 404 len: 109 microversion: 2.1 time: 0.055510 Jun 24 10:01:12.460496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 24/44] 10.222.0.26 () {58 vars in 1244 bytes} [Fri Jun 24 10:01:12 2022] GET /compute/v2.1/os-volumes/174378d9-26d1-4740-8e71-f6d101b02b09 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:01:13.875178 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-cd04bc3f-2562-4291-a2e1-398c07ca18e8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-538741196", "imageRef": "f6b1dddb-2953-41a2-99e3-00aeca441bd9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:01:13.997845 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-47bf5320-77cf-49df-89fd-3b2f7623d384 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Flavor limits 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:01:13.998358 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-47bf5320-77cf-49df-89fd-3b2f7623d384 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Image limits 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:01:13.998740 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-47bf5320-77cf-49df-89fd-3b2f7623d384 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Flavor pref 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:01:13.999151 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-47bf5320-77cf-49df-89fd-3b2f7623d384 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Image pref 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:01:13.999574 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-47bf5320-77cf-49df-89fd-3b2f7623d384 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:01:14.057230 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-47bf5320-77cf-49df-89fd-3b2f7623d384 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:14.060540 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-47bf5320-77cf-49df-89fd-3b2f7623d384 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:14.070275 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-47bf5320-77cf-49df-89fd-3b2f7623d384 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:14.072225 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-47bf5320-77cf-49df-89fd-3b2f7623d384 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:14.171826 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.network.neutron [None req-cd04bc3f-2562-4291-a2e1-398c07ca18e8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] validate_networks() for [('fa5f3eea-22fa-49e9-863b-48d0ee7aa7fa', None, None, None, None, None)] {{(pid=124979) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:01:14.252792 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-47bf5320-77cf-49df-89fd-3b2f7623d384 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Getting quotas for project 6e8e5400d9ee4b6bbe129f4b7327cdf3. Resources: {'instances', 'cores', 'ram'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:01:14.271211 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-47bf5320-77cf-49df-89fd-3b2f7623d384 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Getting quotas for user 9e8b45e1b2524140bffcee941b151f24 and project 6e8e5400d9ee4b6bbe129f4b7327cdf3. Resources: {'instances', 'cores', 'ram'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:01:14.325259 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-47bf5320-77cf-49df-89fd-3b2f7623d384 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Going to run 1 instances... {{(pid=124980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:01:14.345808 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-47bf5320-77cf-49df-89fd-3b2f7623d384 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6b1dddb-2953-41a2-99e3-00aeca441bd9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:01:14.655026 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-47bf5320-77cf-49df-89fd-3b2f7623d384 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.651868 Jun 24 10:01:14.655822 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 21/45] 10.222.0.26 () {60 vars in 1146 bytes} [Fri Jun 24 10:01:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:01:14.687586 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-a9ae7b8c-fd92-4fff-939c-32005d37a170 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-855625787", "imageRef": "f6b1dddb-2953-41a2-99e3-00aeca441bd9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "acbbe71d-fc88-4521-a985-304e44d1216d"}], "security_groups": [{"name": "tempest-securitygroup--425640235"}], "key_name": "tempest-keypair-541898312", "user_data": "}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:01:15.190427 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.network.neutron [None req-a9ae7b8c-fd92-4fff-939c-32005d37a170 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] validate_networks() for [('acbbe71d-fc88-4521-a985-304e44d1216d', None, None, None, None, None)] {{(pid=124980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:01:16.098604 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-cd04bc3f-2562-4291-a2e1-398c07ca18e8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Flavor limits 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:01:16.099647 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-cd04bc3f-2562-4291-a2e1-398c07ca18e8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Image limits 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:01:16.100332 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-cd04bc3f-2562-4291-a2e1-398c07ca18e8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Flavor pref 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:01:16.102288 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-cd04bc3f-2562-4291-a2e1-398c07ca18e8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Image pref 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:01:16.103464 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-cd04bc3f-2562-4291-a2e1-398c07ca18e8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:01:16.208218 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-cd04bc3f-2562-4291-a2e1-398c07ca18e8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:16.209474 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-cd04bc3f-2562-4291-a2e1-398c07ca18e8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:16.212561 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-cd04bc3f-2562-4291-a2e1-398c07ca18e8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:16.220803 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-cd04bc3f-2562-4291-a2e1-398c07ca18e8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:16.287758 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-cd04bc3f-2562-4291-a2e1-398c07ca18e8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Getting quotas for project ddf89eff2d584c508a967f1686090be1. Resources: {'instances', 'cores', 'ram'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:01:16.300283 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-cd04bc3f-2562-4291-a2e1-398c07ca18e8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Getting quotas for user b03913e742104648977aa5d61347f38e and project ddf89eff2d584c508a967f1686090be1. Resources: {'instances', 'cores', 'ram'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:01:16.344868 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-cd04bc3f-2562-4291-a2e1-398c07ca18e8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Going to run 1 instances... {{(pid=124979) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:01:16.391029 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-cd04bc3f-2562-4291-a2e1-398c07ca18e8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6b1dddb-2953-41a2-99e3-00aeca441bd9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124979) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:01:16.602528 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-cd04bc3f-2562-4291-a2e1-398c07ca18e8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.499490 Jun 24 10:01:16.608584 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 25/46] 10.222.0.26 () {60 vars in 1146 bytes} [Fri Jun 24 10:01:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 3507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:01:16.619600 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-efa7b715-ef74-457e-9ab5-dd494602e08f tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:16.633501 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-efa7b715-ef74-457e-9ab5-dd494602e08f tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:16.738230 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-a9ae7b8c-fd92-4fff-939c-32005d37a170 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Flavor limits 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:01:16.743776 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-a9ae7b8c-fd92-4fff-939c-32005d37a170 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Image limits 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:01:16.744416 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-a9ae7b8c-fd92-4fff-939c-32005d37a170 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Flavor pref 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:01:16.747627 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-a9ae7b8c-fd92-4fff-939c-32005d37a170 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Image pref 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:01:16.748279 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-a9ae7b8c-fd92-4fff-939c-32005d37a170 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:01:16.763414 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a9ae7b8c-fd92-4fff-939c-32005d37a170 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:16.764265 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a9ae7b8c-fd92-4fff-939c-32005d37a170 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:16.766777 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a9ae7b8c-fd92-4fff-939c-32005d37a170 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:16.767452 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a9ae7b8c-fd92-4fff-939c-32005d37a170 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:16.790875 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-a9ae7b8c-fd92-4fff-939c-32005d37a170 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Getting quotas for project a77797eae68a42639f886f64db5f5598. Resources: {'instances', 'cores', 'ram'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:01:16.801073 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-a9ae7b8c-fd92-4fff-939c-32005d37a170 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Getting quotas for user cd894c323c604ed593a01d17092e6c2a and project a77797eae68a42639f886f64db5f5598. Resources: {'instances', 'cores', 'ram'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:01:16.834869 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-a9ae7b8c-fd92-4fff-939c-32005d37a170 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Going to run 1 instances... {{(pid=124980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:01:16.858511 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-a9ae7b8c-fd92-4fff-939c-32005d37a170 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6b1dddb-2953-41a2-99e3-00aeca441bd9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:01:17.015342 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-efa7b715-ef74-457e-9ab5-dd494602e08f tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:17.065748 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-efa7b715-ef74-457e-9ab5-dd494602e08f tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1214 microversion: 2.1 time: 0.447385 Jun 24 10:01:17.066596 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 26/47] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:16 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1214 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:17.081797 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-90dd8303-5954-4ce2-be96-d5fa8b8eddac tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:17.083651 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-90dd8303-5954-4ce2-be96-d5fa8b8eddac tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:17.220237 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-a9ae7b8c-fd92-4fff-939c-32005d37a170 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.546814 Jun 24 10:01:17.227547 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 22/48] 10.222.0.26 () {62 vars in 1187 bytes} [Fri Jun 24 10:01:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 2552 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 24 10:01:17.238270 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-9e67b6d6-c85c-4aaf-832d-37ed6f07e5a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1521370447", "imageRef": "f6b1dddb-2953-41a2-99e3-00aeca441bd9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c8f19ac-e8c2-4044-a226-361510084949"}], "security_groups": [{"name": "tempest-securitygroup--554624074"}], "key_name": "tempest-keypair-170224298", "user_data": "}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:01:17.288116 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-90dd8303-5954-4ce2-be96-d5fa8b8eddac tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:17.309675 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-90dd8303-5954-4ce2-be96-d5fa8b8eddac tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1221 microversion: 2.1 time: 0.232551 Jun 24 10:01:17.312284 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 27/49] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:17 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1221 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:17.318546 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-dbecd3c6-83e2-409a-bd66-6ec51ce05d5f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:17.319169 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-dbecd3c6-83e2-409a-bd66-6ec51ce05d5f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:17.498046 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-dbecd3c6-83e2-409a-bd66-6ec51ce05d5f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:17.512693 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-dbecd3c6-83e2-409a-bd66-6ec51ce05d5f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:17.519550 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-dbecd3c6-83e2-409a-bd66-6ec51ce05d5f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:17.522923 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-dbecd3c6-83e2-409a-bd66-6ec51ce05d5f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1280 microversion: 2.20 time: 0.208230 Jun 24 10:01:17.527794 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 28/50] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:01:17 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1280 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:01:17.528412 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.network.neutron [None req-9e67b6d6-c85c-4aaf-832d-37ed6f07e5a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] validate_networks() for [('3c8f19ac-e8c2-4044-a226-361510084949', None, None, None, None, None)] {{(pid=124980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:01:18.021590 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-06770a9c-4074-430b-93f8-041cf4c49076 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-220132784", "imageRef": "f6b1dddb-2953-41a2-99e3-00aeca441bd9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:01:18.104867 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.network.neutron [None req-06770a9c-4074-430b-93f8-041cf4c49076 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] validate_networks() for [('fa5f3eea-22fa-49e9-863b-48d0ee7aa7fa', None, None, None, None, None)] {{(pid=124979) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:01:18.790100 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-9e67b6d6-c85c-4aaf-832d-37ed6f07e5a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Flavor limits 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:01:18.790585 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-9e67b6d6-c85c-4aaf-832d-37ed6f07e5a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Image limits 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:01:18.791126 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-9e67b6d6-c85c-4aaf-832d-37ed6f07e5a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Flavor pref 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:01:18.791543 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-9e67b6d6-c85c-4aaf-832d-37ed6f07e5a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Image pref 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:01:18.791955 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-9e67b6d6-c85c-4aaf-832d-37ed6f07e5a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:01:18.835113 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9e67b6d6-c85c-4aaf-832d-37ed6f07e5a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:18.837490 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9e67b6d6-c85c-4aaf-832d-37ed6f07e5a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:18.838428 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9e67b6d6-c85c-4aaf-832d-37ed6f07e5a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:18.843006 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9e67b6d6-c85c-4aaf-832d-37ed6f07e5a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:18.902366 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-9e67b6d6-c85c-4aaf-832d-37ed6f07e5a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Getting quotas for project b57a965c8ac24ad383260d621813bc3b. Resources: {'instances', 'cores', 'ram'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:01:18.910720 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-9e67b6d6-c85c-4aaf-832d-37ed6f07e5a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Getting quotas for user b9d6654cd5c54c0294cbe1e2a1204c76 and project b57a965c8ac24ad383260d621813bc3b. Resources: {'instances', 'cores', 'ram'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:01:18.947064 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-9e67b6d6-c85c-4aaf-832d-37ed6f07e5a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Going to run 1 instances... {{(pid=124980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:01:18.950329 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-9e67b6d6-c85c-4aaf-832d-37ed6f07e5a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6b1dddb-2953-41a2-99e3-00aeca441bd9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:01:19.136606 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-06770a9c-4074-430b-93f8-041cf4c49076 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Flavor limits 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:01:19.137137 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-06770a9c-4074-430b-93f8-041cf4c49076 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Image limits 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:01:19.137494 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-06770a9c-4074-430b-93f8-041cf4c49076 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Flavor pref 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:01:19.137905 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-06770a9c-4074-430b-93f8-041cf4c49076 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Image pref 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:01:19.138325 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-06770a9c-4074-430b-93f8-041cf4c49076 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:01:19.149653 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-06770a9c-4074-430b-93f8-041cf4c49076 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:19.150109 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-06770a9c-4074-430b-93f8-041cf4c49076 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:19.150982 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-06770a9c-4074-430b-93f8-041cf4c49076 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:19.151433 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-06770a9c-4074-430b-93f8-041cf4c49076 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:19.178078 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-06770a9c-4074-430b-93f8-041cf4c49076 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Getting quotas for project ddf89eff2d584c508a967f1686090be1. Resources: {'instances', 'cores', 'ram'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:01:19.182693 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-06770a9c-4074-430b-93f8-041cf4c49076 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Getting quotas for user b03913e742104648977aa5d61347f38e and project ddf89eff2d584c508a967f1686090be1. Resources: {'instances', 'cores', 'ram'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:01:19.198366 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-06770a9c-4074-430b-93f8-041cf4c49076 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Going to run 1 instances... {{(pid=124979) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:01:19.201162 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-06770a9c-4074-430b-93f8-041cf4c49076 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6b1dddb-2953-41a2-99e3-00aeca441bd9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124979) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:01:19.236405 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-9e67b6d6-c85c-4aaf-832d-37ed6f07e5a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.009302 Jun 24 10:01:19.237092 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 23/51] 10.222.0.26 () {60 vars in 1146 bytes} [Fri Jun 24 10:01:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 2014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:01:19.242554 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-ef47e378-a70a-4a42-9295-f782bba1ddba tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:19.243483 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-ef47e378-a70a-4a42-9295-f782bba1ddba tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:19.267487 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ef47e378-a70a-4a42-9295-f782bba1ddba tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:19.269069 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ef47e378-a70a-4a42-9295-f782bba1ddba tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:19.270503 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ef47e378-a70a-4a42-9295-f782bba1ddba tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:19.271773 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ef47e378-a70a-4a42-9295-f782bba1ddba tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:19.431628 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-06770a9c-4074-430b-93f8-041cf4c49076 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.407390 Jun 24 10:01:19.433150 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 29/52] 10.222.0.26 () {60 vars in 1146 bytes} [Fri Jun 24 10:01:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 1418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 10:01:19.451633 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-ca8c0245-1ad2-4fbf-b233-f722223636ad tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:19.461080 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-ca8c0245-1ad2-4fbf-b233-f722223636ad tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:19.499151 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ca8c0245-1ad2-4fbf-b233-f722223636ad tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:19.500726 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ca8c0245-1ad2-4fbf-b233-f722223636ad tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:19.504710 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ca8c0245-1ad2-4fbf-b233-f722223636ad tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:19.505187 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ca8c0245-1ad2-4fbf-b233-f722223636ad tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:19.602080 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-ef47e378-a70a-4a42-9295-f782bba1ddba tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:19.640703 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-ef47e378-a70a-4a42-9295-f782bba1ddba tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1266 microversion: 2.1 time: 0.402200 Jun 24 10:01:19.641300 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 24/53] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:19 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1266 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:19.662343 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-38dcc06d-a49d-4aac-86c4-302b4fe2b4d3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:19.668811 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-38dcc06d-a49d-4aac-86c4-302b4fe2b4d3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:19.743411 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-38dcc06d-a49d-4aac-86c4-302b4fe2b4d3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:19.755671 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-38dcc06d-a49d-4aac-86c4-302b4fe2b4d3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1237 microversion: 2.1 time: 0.097161 Jun 24 10:01:19.756527 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 25/54] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:19 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1237 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:19.766712 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-0ed5baab-b798-495b-9f67-0f606f660129 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:19.766712 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-0ed5baab-b798-495b-9f67-0f606f660129 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:19.870984 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-ca8c0245-1ad2-4fbf-b233-f722223636ad tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:19.895069 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-0ed5baab-b798-495b-9f67-0f606f660129 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:19.898151 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-ca8c0245-1ad2-4fbf-b233-f722223636ad tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:19.899946 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-ca8c0245-1ad2-4fbf-b233-f722223636ad tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:19.905921 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-ca8c0245-1ad2-4fbf-b233-f722223636ad tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1284 microversion: 2.20 time: 0.470645 Jun 24 10:01:19.908218 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 30/55] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:01:19 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1284 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:01:19.919595 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-0ed5baab-b798-495b-9f67-0f606f660129 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1221 microversion: 2.1 time: 0.149079 Jun 24 10:01:19.926805 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 26/56] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:19 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1221 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:20.658516 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-78e4a4b0-0d2a-46f0-b736-4c4b6b92895c tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:20.659220 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-78e4a4b0-0d2a-46f0-b736-4c4b6b92895c tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:20.670389 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-78e4a4b0-0d2a-46f0-b736-4c4b6b92895c tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:20.672246 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-78e4a4b0-0d2a-46f0-b736-4c4b6b92895c tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:20.672703 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-78e4a4b0-0d2a-46f0-b736-4c4b6b92895c tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:20.673298 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-78e4a4b0-0d2a-46f0-b736-4c4b6b92895c tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:20.779930 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-794bc51d-f692-4cef-b31d-7c3cb172b091 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:20.780757 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-794bc51d-f692-4cef-b31d-7c3cb172b091 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:20.794197 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-78e4a4b0-0d2a-46f0-b736-4c4b6b92895c tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:20.805231 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-78e4a4b0-0d2a-46f0-b736-4c4b6b92895c tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1284 microversion: 2.1 time: 0.150211 Jun 24 10:01:20.806133 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 31/57] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:20 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:20.878842 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-794bc51d-f692-4cef-b31d-7c3cb172b091 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:20.886722 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-794bc51d-f692-4cef-b31d-7c3cb172b091 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1237 microversion: 2.1 time: 0.111158 Jun 24 10:01:20.887311 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 27/58] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:20 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1237 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:20.925265 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-0ecb4542-aa0b-4a62-8010-362859eb6621 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:20.925898 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-0ecb4542-aa0b-4a62-8010-362859eb6621 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:20.939985 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0ecb4542-aa0b-4a62-8010-362859eb6621 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:20.941799 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0ecb4542-aa0b-4a62-8010-362859eb6621 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:20.942610 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0ecb4542-aa0b-4a62-8010-362859eb6621 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:20.943721 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0ecb4542-aa0b-4a62-8010-362859eb6621 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:20.949216 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-4c25bcdf-172f-4408-8c7e-632bdac58c5c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:20.954558 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-4c25bcdf-172f-4408-8c7e-632bdac58c5c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:21.042448 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-4c25bcdf-172f-4408-8c7e-632bdac58c5c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:21.051908 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-4c25bcdf-172f-4408-8c7e-632bdac58c5c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1221 microversion: 2.1 time: 0.114609 Jun 24 10:01:21.053079 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 28/59] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:20 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1221 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:21.101500 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-0ecb4542-aa0b-4a62-8010-362859eb6621 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:21.117756 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-0ecb4542-aa0b-4a62-8010-362859eb6621 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:21.130561 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-0ecb4542-aa0b-4a62-8010-362859eb6621 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:21.131280 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-0ecb4542-aa0b-4a62-8010-362859eb6621 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1332 microversion: 2.20 time: 0.209682 Jun 24 10:01:21.133397 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 32/60] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:01:20 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1332 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:01:21.831021 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-03e4ac8e-afb6-4c54-9816-90759eff369f tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:21.834882 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-03e4ac8e-afb6-4c54-9816-90759eff369f tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:21.864155 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-03e4ac8e-afb6-4c54-9816-90759eff369f tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:21.864898 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-03e4ac8e-afb6-4c54-9816-90759eff369f tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:21.865890 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-03e4ac8e-afb6-4c54-9816-90759eff369f tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:21.866330 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-03e4ac8e-afb6-4c54-9816-90759eff369f tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:22.131749 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-302fb59d-d210-4ec1-be1f-9e3a820c432a tempest-VolumesNegativeTest-974724435 tempest-VolumesNegativeTest-974724435-project] Action: 'create', calling method: .version_select at 0x7f0309e7b9d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-387665477", "metadata": {"Type": "work"}}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:01:22.141978 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-03e4ac8e-afb6-4c54-9816-90759eff369f tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:22.150721 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-302fb59d-d210-4ec1-be1f-9e3a820c432a tempest-VolumesNegativeTest-974724435 tempest-VolumesNegativeTest-974724435-project] Request method failure captured: Jun 24 10:01:22.150721 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 10:01:22.150721 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept: application/json Jun 24 10:01:22.150721 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept-Encoding: identity Jun 24 10:01:22.150721 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Connection: close Jun 24 10:01:22.150721 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Length: 121 Jun 24 10:01:22.150721 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Type: application/json Jun 24 10:01:22.150721 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Host: 10.222.0.26 Jun 24 10:01:22.150721 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Openstack-System-Scope: None Jun 24 10:01:22.150721 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: User-Agent: python-urllib3/1.26.9 Jun 24 10:01:22.150721 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Auth-Token: gAAAAABitYtxJTROwknij8MAeaYyntoUSII6MZAbwvnL6eC2-N6wmTUBAX6ZsK_y2q6bOaDXbd72cpMkl6PwCqon6-9mX-_cX8-bnsWOB9GCyQbq5P2T94D6OqNOel9tIOkq_BusP83duF7ojr4xd9xnHcfRDWnrgYS4OR0Pg9hGJc0gf64Hplk Jun 24 10:01:22.150721 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Id: None Jun 24 10:01:22.150721 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Name: None Jun 24 10:01:22.150721 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Identity-Status: Confirmed Jun 24 10:01:22.150721 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Is-Admin-Project: True Jun 24 10:01:22.150721 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Id: default Jun 24 10:01:22.150721 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Name: Default Jun 24 10:01:22.150721 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Id: 5c63109cbb94476fac8c1ce04a931424 Jun 24 10:01:22.150721 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Name: tempest-VolumesNegativeTest-974724435 Jun 24 10:01:22.150721 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Role: reader,member Jun 24 10:01:22.150721 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Roles: reader,member Jun 24 10:01:22.151896 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5c63109cbb94476fac8c1ce04a931424"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5c63109cbb94476fac8c1ce04a931424", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c63109cbb94476fac8c1ce04a931424"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c63109cbb94476fac8c1ce04a931424"}]}] Jun 24 10:01:22.151896 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant: tempest-VolumesNegativeTest-974724435 Jun 24 10:01:22.151896 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Id: 5c63109cbb94476fac8c1ce04a931424 Jun 24 10:01:22.151896 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Name: tempest-VolumesNegativeTest-974724435 Jun 24 10:01:22.151896 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User: tempest-VolumesNegativeTest-974724435-project Jun 24 10:01:22.151896 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Id: default Jun 24 10:01:22.151896 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Name: Default Jun 24 10:01:22.151896 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Id: d9960b92b22b4645a2c5735119ebf547 Jun 24 10:01:22.151896 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Name: tempest-VolumesNegativeTest-974724435-project Jun 24 10:01:22.151896 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Jun 24 10:01:22.151896 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-387665477", "metadata": {"Type": "work"}}} Jun 24 10:01:22.151896 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: method: Jun 24 10:01:22.151896 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 10:01:22.157471 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-387665477', 'metadata': {'Type': 'work'}}}} Jun 24 10:01:22.157471 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:01:22.157471 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:22.157471 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 10:01:22.157471 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 10:01:22.157471 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 10:01:22.157471 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise error Jun 24 10:01:22.157471 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 24 10:01:22.157471 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.157471 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 24 10:01:22.157471 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 10:01:22.157471 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.157471 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 10:01:22.157471 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi '#$%' Jun 24 10:01:22.157471 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.157471 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:01:22.157471 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.157471 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:22.157471 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:01:22.157471 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:01:22.157471 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:01:22.157471 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:01:22.158563 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:01:22.158563 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:01:22.158563 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:01:22.158563 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:01:22.158563 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 10:01:22.158563 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 10:01:22.158563 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 10:01:22.158563 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 10:01:22.158563 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 10:01:22.158563 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 10:01:22.158563 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 10:01:22.158563 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.158563 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:01:22.158563 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.158563 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:22.158563 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:01:22.158563 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:01:22.158563 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 10:01:22.158563 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 10:01:22.159508 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 10:01:22.159508 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.159508 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-302fb59d-d210-4ec1-be1f-9e3a820c432a tempest-VolumesNegativeTest-974724435 tempest-VolumesNegativeTest-974724435-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:01:22.159682 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-03e4ac8e-afb6-4c54-9816-90759eff369f tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1314 microversion: 2.1 time: 0.327790 Jun 24 10:01:22.159682 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 33/61] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:21 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:22.167187 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-302fb59d-d210-4ec1-be1f-9e3a820c432a tempest-VolumesNegativeTest-974724435 tempest-VolumesNegativeTest-974724435-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.529171 Jun 24 10:01:22.168574 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 29/62] 10.222.0.26 () {60 vars in 1155 bytes} [Fri Jun 24 10:01:21 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 544 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 10:01:22.184261 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-0f17a051-f928-44b9-a7ce-a32a5e538e63 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:22.188011 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-0f17a051-f928-44b9-a7ce-a32a5e538e63 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:22.200784 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-9bd13b7a-09fc-460e-837d-b85865dfb0ca tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:22.202935 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0f17a051-f928-44b9-a7ce-a32a5e538e63 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:22.202935 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0f17a051-f928-44b9-a7ce-a32a5e538e63 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:22.204680 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-9bd13b7a-09fc-460e-837d-b85865dfb0ca tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:22.207225 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0f17a051-f928-44b9-a7ce-a32a5e538e63 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:22.209872 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0f17a051-f928-44b9-a7ce-a32a5e538e63 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:22.244574 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9bd13b7a-09fc-460e-837d-b85865dfb0ca tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:22.252858 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9bd13b7a-09fc-460e-837d-b85865dfb0ca tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:22.254570 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9bd13b7a-09fc-460e-837d-b85865dfb0ca tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:22.260590 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9bd13b7a-09fc-460e-837d-b85865dfb0ca tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:22.466833 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-0f17a051-f928-44b9-a7ce-a32a5e538e63 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:22.486568 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-0f17a051-f928-44b9-a7ce-a32a5e538e63 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1217 microversion: 2.1 time: 0.316285 Jun 24 10:01:22.487501 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 30/63] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:22 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1217 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:22.499990 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-92ea9183-16f8-434b-82e5-045d23b55ec9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:22.506189 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-92ea9183-16f8-434b-82e5-045d23b55ec9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:22.527473 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-9bd13b7a-09fc-460e-837d-b85865dfb0ca tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:22.529867 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-92ea9183-16f8-434b-82e5-045d23b55ec9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:22.533851 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-92ea9183-16f8-434b-82e5-045d23b55ec9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:22.539410 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-92ea9183-16f8-434b-82e5-045d23b55ec9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:22.550386 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-92ea9183-16f8-434b-82e5-045d23b55ec9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:22.560754 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-9bd13b7a-09fc-460e-837d-b85865dfb0ca tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1289 microversion: 2.1 time: 0.402397 Jun 24 10:01:22.574500 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 34/64] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:22 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1289 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:22.598546 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-dded53ec-18d6-4c52-93ba-849bffe1a6a2 tempest-VolumesNegativeTest-974724435 tempest-VolumesNegativeTest-974724435-project] Action: 'create', calling method: .version_select at 0x7f0309e8b280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1568516950", "metadata": {"Type": "work"}}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:01:22.607950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-dded53ec-18d6-4c52-93ba-849bffe1a6a2 tempest-VolumesNegativeTest-974724435 tempest-VolumesNegativeTest-974724435-project] Request method failure captured: Jun 24 10:01:22.607950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 10:01:22.607950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:01:22.607950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:01:22.607950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:01:22.607950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 120 Jun 24 10:01:22.607950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:01:22.607950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:01:22.607950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:01:22.607950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:01:22.607950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitYtxJTROwknij8MAeaYyntoUSII6MZAbwvnL6eC2-N6wmTUBAX6ZsK_y2q6bOaDXbd72cpMkl6PwCqon6-9mX-_cX8-bnsWOB9GCyQbq5P2T94D6OqNOel9tIOkq_BusP83duF7ojr4xd9xnHcfRDWnrgYS4OR0Pg9hGJc0gf64Hplk Jun 24 10:01:22.607950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:01:22.607950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:01:22.607950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:01:22.607950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:01:22.607950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:01:22.607950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:01:22.607950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: 5c63109cbb94476fac8c1ce04a931424 Jun 24 10:01:22.607950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-VolumesNegativeTest-974724435 Jun 24 10:01:22.607950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:01:22.607950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:01:22.609783 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5c63109cbb94476fac8c1ce04a931424"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5c63109cbb94476fac8c1ce04a931424", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c63109cbb94476fac8c1ce04a931424"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c63109cbb94476fac8c1ce04a931424"}]}] Jun 24 10:01:22.609783 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-VolumesNegativeTest-974724435 Jun 24 10:01:22.609783 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: 5c63109cbb94476fac8c1ce04a931424 Jun 24 10:01:22.609783 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-VolumesNegativeTest-974724435 Jun 24 10:01:22.609783 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-VolumesNegativeTest-974724435-project Jun 24 10:01:22.609783 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:01:22.609783 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:01:22.609783 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: d9960b92b22b4645a2c5735119ebf547 Jun 24 10:01:22.609783 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-VolumesNegativeTest-974724435-project Jun 24 10:01:22.609783 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Jun 24 10:01:22.609783 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1568516950", "metadata": {"Type": "work"}}} Jun 24 10:01:22.609783 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: Jun 24 10:01:22.609783 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 10:01:22.610461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1568516950', 'metadata': {'Type': 'work'}}}} Jun 24 10:01:22.610461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:01:22.610461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:22.610461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 10:01:22.610461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 10:01:22.610461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 10:01:22.610461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise error Jun 24 10:01:22.610461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 24 10:01:22.610461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.610461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 24 10:01:22.610461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 10:01:22.610461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.610461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 10:01:22.610461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi '0' Jun 24 10:01:22.610461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.610461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:01:22.610461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.610461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:22.610461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:01:22.610461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:01:22.610461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:01:22.610461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:01:22.611545 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:01:22.611545 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:01:22.611545 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:01:22.611545 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:01:22.611545 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 10:01:22.611545 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 10:01:22.611545 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 10:01:22.611545 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 10:01:22.611545 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 10:01:22.611545 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 10:01:22.611545 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 10:01:22.611545 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.611545 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:01:22.611545 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.611545 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:22.611545 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:01:22.611545 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:01:22.611545 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 10:01:22.611545 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 10:01:22.612507 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 10:01:22.612507 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.616790 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-dded53ec-18d6-4c52-93ba-849bffe1a6a2 tempest-VolumesNegativeTest-974724435 tempest-VolumesNegativeTest-974724435-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:01:22.619855 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-dded53ec-18d6-4c52-93ba-849bffe1a6a2 tempest-VolumesNegativeTest-974724435 tempest-VolumesNegativeTest-974724435-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.043030 Jun 24 10:01:22.622482 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 35/65] 10.222.0.26 () {60 vars in 1155 bytes} [Fri Jun 24 10:01:22 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 10:01:22.635259 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-bf37fc99-14ed-4e43-9e70-75d30b598b3c tempest-VolumesNegativeTest-974724435 tempest-VolumesNegativeTest-974724435-project] Action: 'create', calling method: .version_select at 0x7f0309ef1ca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1936552181", "metadata": {"Type": "work"}}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:01:22.640785 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-bf37fc99-14ed-4e43-9e70-75d30b598b3c tempest-VolumesNegativeTest-974724435 tempest-VolumesNegativeTest-974724435-project] Request method failure captured: Jun 24 10:01:22.640785 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 10:01:22.640785 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:01:22.640785 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:01:22.640785 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:01:22.640785 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 119 Jun 24 10:01:22.640785 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:01:22.640785 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:01:22.640785 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:01:22.640785 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:01:22.640785 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitYtxJTROwknij8MAeaYyntoUSII6MZAbwvnL6eC2-N6wmTUBAX6ZsK_y2q6bOaDXbd72cpMkl6PwCqon6-9mX-_cX8-bnsWOB9GCyQbq5P2T94D6OqNOel9tIOkq_BusP83duF7ojr4xd9xnHcfRDWnrgYS4OR0Pg9hGJc0gf64Hplk Jun 24 10:01:22.640785 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:01:22.640785 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:01:22.640785 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:01:22.640785 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:01:22.640785 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:01:22.640785 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:01:22.640785 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: 5c63109cbb94476fac8c1ce04a931424 Jun 24 10:01:22.640785 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-VolumesNegativeTest-974724435 Jun 24 10:01:22.640785 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:01:22.640785 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:01:22.641953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5c63109cbb94476fac8c1ce04a931424"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5c63109cbb94476fac8c1ce04a931424", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c63109cbb94476fac8c1ce04a931424"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c63109cbb94476fac8c1ce04a931424"}]}] Jun 24 10:01:22.641953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-VolumesNegativeTest-974724435 Jun 24 10:01:22.641953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: 5c63109cbb94476fac8c1ce04a931424 Jun 24 10:01:22.641953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-VolumesNegativeTest-974724435 Jun 24 10:01:22.641953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-VolumesNegativeTest-974724435-project Jun 24 10:01:22.641953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:01:22.641953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:01:22.641953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: d9960b92b22b4645a2c5735119ebf547 Jun 24 10:01:22.641953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-VolumesNegativeTest-974724435-project Jun 24 10:01:22.641953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Jun 24 10:01:22.641953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1936552181", "metadata": {"Type": "work"}}} Jun 24 10:01:22.641953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: Jun 24 10:01:22.641953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 10:01:22.642603 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1936552181', 'metadata': {'Type': 'work'}}}} Jun 24 10:01:22.642603 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:01:22.642603 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:22.642603 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 10:01:22.642603 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 10:01:22.642603 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 10:01:22.642603 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise error Jun 24 10:01:22.642603 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 24 10:01:22.642603 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.642603 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 24 10:01:22.642603 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 10:01:22.642603 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.642603 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 10:01:22.642603 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi '' Jun 24 10:01:22.642603 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.642603 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:01:22.642603 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.642603 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:22.642603 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:01:22.642603 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:01:22.642603 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:01:22.642603 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:01:22.643794 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:01:22.643794 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:01:22.643794 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:01:22.643794 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:01:22.643794 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 10:01:22.643794 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 10:01:22.643794 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 10:01:22.643794 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 10:01:22.643794 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 10:01:22.643794 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 10:01:22.643794 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 10:01:22.643794 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.643794 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:01:22.643794 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.643794 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:22.643794 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:01:22.643794 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:01:22.643794 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 10:01:22.643794 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 10:01:22.645983 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 10:01:22.645983 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.648955 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-bf37fc99-14ed-4e43-9e70-75d30b598b3c tempest-VolumesNegativeTest-974724435 tempest-VolumesNegativeTest-974724435-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:01:22.650246 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-bf37fc99-14ed-4e43-9e70-75d30b598b3c tempest-VolumesNegativeTest-974724435 tempest-VolumesNegativeTest-974724435-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.022877 Jun 24 10:01:22.654921 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 36/66] 10.222.0.26 () {60 vars in 1155 bytes} [Fri Jun 24 10:01:22 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 10:01:22.680707 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-92d39b4a-c524-4fd0-980f-8b0f8539b6db tempest-VolumesNegativeTest-974724435 tempest-VolumesNegativeTest-974724435-project] Calling method '.version_select at 0x7f0309ef1670>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:22.727674 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-92d39b4a-c524-4fd0-980f-8b0f8539b6db tempest-VolumesNegativeTest-974724435 tempest-VolumesNegativeTest-974724435-project] HTTP exception thrown: Volume tempest-invalid-2075123261 could not be found. Jun 24 10:01:22.729665 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-92d39b4a-c524-4fd0-980f-8b0f8539b6db tempest-VolumesNegativeTest-974724435 tempest-VolumesNegativeTest-974724435-project] Request method failure captured: Jun 24 10:01:22.729665 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2075123261 HTTP/1.1 Jun 24 10:01:22.729665 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:01:22.729665 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:01:22.729665 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:01:22.729665 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 0 Jun 24 10:01:22.729665 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:01:22.729665 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:01:22.729665 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:01:22.729665 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:01:22.729665 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitYtxJTROwknij8MAeaYyntoUSII6MZAbwvnL6eC2-N6wmTUBAX6ZsK_y2q6bOaDXbd72cpMkl6PwCqon6-9mX-_cX8-bnsWOB9GCyQbq5P2T94D6OqNOel9tIOkq_BusP83duF7ojr4xd9xnHcfRDWnrgYS4OR0Pg9hGJc0gf64Hplk Jun 24 10:01:22.729665 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:01:22.729665 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:01:22.729665 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:01:22.729665 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:01:22.729665 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:01:22.729665 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:01:22.729665 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: 5c63109cbb94476fac8c1ce04a931424 Jun 24 10:01:22.729665 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-VolumesNegativeTest-974724435 Jun 24 10:01:22.729665 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:01:22.729665 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:01:22.730835 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5c63109cbb94476fac8c1ce04a931424"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5c63109cbb94476fac8c1ce04a931424", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c63109cbb94476fac8c1ce04a931424"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c63109cbb94476fac8c1ce04a931424"}]}] Jun 24 10:01:22.730835 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-VolumesNegativeTest-974724435 Jun 24 10:01:22.730835 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: 5c63109cbb94476fac8c1ce04a931424 Jun 24 10:01:22.730835 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-VolumesNegativeTest-974724435 Jun 24 10:01:22.730835 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-VolumesNegativeTest-974724435-project Jun 24 10:01:22.730835 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:01:22.730835 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:01:22.730835 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: d9960b92b22b4645a2c5735119ebf547 Jun 24 10:01:22.730835 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-VolumesNegativeTest-974724435-project Jun 24 10:01:22.730835 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: Jun 24 10:01:22.730835 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Volume tempest-invalid-2075123261 could not be found. Jun 24 10:01:22.730835 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'id': 'tempest-invalid-2075123261'} Jun 24 10:01:22.730835 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:01:22.731539 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:22.731539 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:01:22.731539 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:01:22.731539 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 10:01:22.731539 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 10:01:22.731539 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 10:01:22.731539 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 10:01:22.731539 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 10:01:22.731539 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 10:01:22.731539 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 10:01:22.731539 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 10:01:22.731539 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:01:22.731539 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:01:22.731539 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:01:22.731539 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:01:22.731539 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2075123261 could not be found. (HTTP 404) (Request-ID: req-b394e0b2-123e-4d24-b0b9-bb357ae6bb81) Jun 24 10:01:22.731539 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.731539 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:01:22.731539 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.732815 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:22.732815 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 10:01:22.732815 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 10:01:22.732815 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 10:01:22.732815 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 10:01:22.732815 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 10:01:22.732815 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 10:01:22.732815 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 10:01:22.732815 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 10:01:22.732815 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:01:22.732815 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:01:22.732815 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 10:01:22.732815 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 10:01:22.732815 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 10:01:22.732815 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 10:01:22.732815 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 10:01:22.732815 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 10:01:22.732815 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 10:01:22.732815 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 10:01:22.733844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:01:22.733844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:01:22.733844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:01:22.733844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:01:22.733844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2075123261 could not be found. Jun 24 10:01:22.733844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.733844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:01:22.733844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.733844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:22.733844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:01:22.733844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:01:22.733844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:01:22.733844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:01:22.733844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:01:22.733844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:01:22.733844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:01:22.733844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:01:22.733844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 10:01:22.733844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:01:22.733844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2075123261 could not be found. Jun 24 10:01:22.734911 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.734911 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:01:22.734911 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.734911 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:22.734911 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:01:22.734911 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:01:22.734911 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:01:22.734911 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:01:22.734911 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2075123261 could not be found. Jun 24 10:01:22.734911 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.734911 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-92d39b4a-c524-4fd0-980f-8b0f8539b6db tempest-VolumesNegativeTest-974724435 tempest-VolumesNegativeTest-974724435-project] Returning 404 to user: Volume tempest-invalid-2075123261 could not be found. {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:01:22.734911 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-92d39b4a-c524-4fd0-980f-8b0f8539b6db tempest-VolumesNegativeTest-974724435 tempest-VolumesNegativeTest-974724435-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2075123261" status: 404 len: 99 microversion: 2.1 time: 0.070762 Jun 24 10:01:22.738246 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 37/67] 10.222.0.26 () {58 vars in 1217 bytes} [Fri Jun 24 10:01:22 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2075123261 => generated 99 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 24 10:01:22.743988 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-e6e67a14-2ad5-4a45-8d0d-f6499e00f164 tempest-VolumesNegativeTest-974724435 tempest-VolumesNegativeTest-974724435-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004373 Jun 24 10:01:22.755764 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 38/68] 10.222.0.26 () {58 vars in 1139 bytes} [Fri Jun 24 10:01:22 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 24 10:01:22.764492 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-3c96e7fb-07e7-409a-b358-90f2e1ea40ec tempest-VolumesNegativeTest-974724435 tempest-VolumesNegativeTest-974724435-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007197 Jun 24 10:01:22.765310 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 39/69] 10.222.0.26 () {58 vars in 1136 bytes} [Fri Jun 24 10:01:22 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 24 10:01:22.777131 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-f03fc1cb-dacd-4670-a113-5a58dd028b14 tempest-VolumesNegativeTest-974724435 tempest-VolumesNegativeTest-974724435-project] Calling method '.version_select at 0x7f0309e8bb80>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:22.778071 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-92ea9183-16f8-434b-82e5-045d23b55ec9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:22.798698 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-92ea9183-16f8-434b-82e5-045d23b55ec9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:22.803708 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-92ea9183-16f8-434b-82e5-045d23b55ec9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:22.813884 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-92ea9183-16f8-434b-82e5-045d23b55ec9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1350 microversion: 2.20 time: 0.318905 Jun 24 10:01:22.814633 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 31/70] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:01:22 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1350 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:01:22.833266 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-f03fc1cb-dacd-4670-a113-5a58dd028b14 tempest-VolumesNegativeTest-974724435 tempest-VolumesNegativeTest-974724435-project] HTTP exception thrown: Volume ae95448e-4b75-496c-80ae-122f1d43510c could not be found. Jun 24 10:01:22.850334 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-f03fc1cb-dacd-4670-a113-5a58dd028b14 tempest-VolumesNegativeTest-974724435 tempest-VolumesNegativeTest-974724435-project] Request method failure captured: Jun 24 10:01:22.850334 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: DELETE /compute/v2.1/os-volumes/ae95448e-4b75-496c-80ae-122f1d43510c HTTP/1.1 Jun 24 10:01:22.850334 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:01:22.850334 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:01:22.850334 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:01:22.850334 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 0 Jun 24 10:01:22.850334 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:01:22.850334 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:01:22.850334 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:01:22.850334 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:01:22.850334 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitYtxJTROwknij8MAeaYyntoUSII6MZAbwvnL6eC2-N6wmTUBAX6ZsK_y2q6bOaDXbd72cpMkl6PwCqon6-9mX-_cX8-bnsWOB9GCyQbq5P2T94D6OqNOel9tIOkq_BusP83duF7ojr4xd9xnHcfRDWnrgYS4OR0Pg9hGJc0gf64Hplk Jun 24 10:01:22.850334 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:01:22.850334 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:01:22.850334 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:01:22.850334 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:01:22.850334 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:01:22.850334 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:01:22.850334 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: 5c63109cbb94476fac8c1ce04a931424 Jun 24 10:01:22.850334 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-VolumesNegativeTest-974724435 Jun 24 10:01:22.850334 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:01:22.850334 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:01:22.851610 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5c63109cbb94476fac8c1ce04a931424"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5c63109cbb94476fac8c1ce04a931424", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c63109cbb94476fac8c1ce04a931424"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c63109cbb94476fac8c1ce04a931424"}]}] Jun 24 10:01:22.851610 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-VolumesNegativeTest-974724435 Jun 24 10:01:22.851610 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: 5c63109cbb94476fac8c1ce04a931424 Jun 24 10:01:22.851610 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-VolumesNegativeTest-974724435 Jun 24 10:01:22.851610 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-VolumesNegativeTest-974724435-project Jun 24 10:01:22.851610 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:01:22.851610 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:01:22.851610 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: d9960b92b22b4645a2c5735119ebf547 Jun 24 10:01:22.851610 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-VolumesNegativeTest-974724435-project Jun 24 10:01:22.851610 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: Jun 24 10:01:22.851610 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Volume ae95448e-4b75-496c-80ae-122f1d43510c could not be found. Jun 24 10:01:22.851610 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'id': 'ae95448e-4b75-496c-80ae-122f1d43510c'} Jun 24 10:01:22.851610 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:01:22.852340 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:22.852340 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:01:22.852340 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:01:22.852340 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 10:01:22.852340 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 10:01:22.852340 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 10:01:22.852340 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 10:01:22.852340 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 10:01:22.852340 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 10:01:22.852340 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 10:01:22.852340 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 10:01:22.852340 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:01:22.852340 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:01:22.852340 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:01:22.852340 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:01:22.852340 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ae95448e-4b75-496c-80ae-122f1d43510c could not be found. (HTTP 404) (Request-ID: req-da1093e1-c542-449f-9f22-eebd94478c4e) Jun 24 10:01:22.852340 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.852340 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:01:22.852340 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.853282 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:22.853282 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 10:01:22.853282 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 10:01:22.853282 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 10:01:22.853282 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 10:01:22.853282 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 10:01:22.853282 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 10:01:22.853282 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 10:01:22.853282 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 10:01:22.853282 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:01:22.853282 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:01:22.853282 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 10:01:22.853282 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 10:01:22.853282 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 10:01:22.853282 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 10:01:22.853282 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 10:01:22.853282 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 10:01:22.853282 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 10:01:22.853282 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 10:01:22.854294 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:01:22.854294 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:01:22.854294 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:01:22.854294 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:01:22.854294 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ae95448e-4b75-496c-80ae-122f1d43510c could not be found. Jun 24 10:01:22.854294 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.854294 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:01:22.854294 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.854294 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:22.854294 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:01:22.854294 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:01:22.854294 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:01:22.854294 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:01:22.854294 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:01:22.854294 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:01:22.854294 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:01:22.854294 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:01:22.854294 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 10:01:22.854294 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:01:22.857092 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ae95448e-4b75-496c-80ae-122f1d43510c could not be found. Jun 24 10:01:22.857092 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.857092 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:01:22.857092 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.857092 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:22.857092 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:01:22.857092 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:01:22.857092 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:01:22.857092 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:01:22.857092 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ae95448e-4b75-496c-80ae-122f1d43510c could not be found. Jun 24 10:01:22.857092 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.860421 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-f03fc1cb-dacd-4670-a113-5a58dd028b14 tempest-VolumesNegativeTest-974724435 tempest-VolumesNegativeTest-974724435-project] Returning 404 to user: Volume ae95448e-4b75-496c-80ae-122f1d43510c could not be found. {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:01:22.861487 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-f03fc1cb-dacd-4670-a113-5a58dd028b14 tempest-VolumesNegativeTest-974724435 tempest-VolumesNegativeTest-974724435-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/ae95448e-4b75-496c-80ae-122f1d43510c" status: 404 len: 109 microversion: 2.1 time: 0.088411 Jun 24 10:01:22.862274 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 40/71] 10.222.0.26 () {58 vars in 1247 bytes} [Fri Jun 24 10:01:22 2022] DELETE /compute/v2.1/os-volumes/ae95448e-4b75-496c-80ae-122f1d43510c => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:01:22.873004 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-062ac864-a4f7-467a-9247-069d9126f6ed tempest-VolumesNegativeTest-974724435 tempest-VolumesNegativeTest-974724435-project] Calling method '.version_select at 0x7f0309ea1e50>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:22.943737 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.wsgi [None req-062ac864-a4f7-467a-9247-069d9126f6ed tempest-VolumesNegativeTest-974724435 tempest-VolumesNegativeTest-974724435-project] HTTP exception thrown: Volume b64f846e-b818-4a4b-8030-ee38aed851c5 could not be found. Jun 24 10:01:22.946526 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-062ac864-a4f7-467a-9247-069d9126f6ed tempest-VolumesNegativeTest-974724435 tempest-VolumesNegativeTest-974724435-project] Request method failure captured: Jun 24 10:01:22.946526 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: request: GET /compute/v2.1/os-volumes/b64f846e-b818-4a4b-8030-ee38aed851c5 HTTP/1.1 Jun 24 10:01:22.946526 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept: application/json Jun 24 10:01:22.946526 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept-Encoding: identity Jun 24 10:01:22.946526 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Connection: close Jun 24 10:01:22.946526 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Length: 0 Jun 24 10:01:22.946526 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Type: application/json Jun 24 10:01:22.946526 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Host: 10.222.0.26 Jun 24 10:01:22.946526 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Openstack-System-Scope: None Jun 24 10:01:22.946526 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: User-Agent: python-urllib3/1.26.9 Jun 24 10:01:22.946526 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Auth-Token: gAAAAABitYtxJTROwknij8MAeaYyntoUSII6MZAbwvnL6eC2-N6wmTUBAX6ZsK_y2q6bOaDXbd72cpMkl6PwCqon6-9mX-_cX8-bnsWOB9GCyQbq5P2T94D6OqNOel9tIOkq_BusP83duF7ojr4xd9xnHcfRDWnrgYS4OR0Pg9hGJc0gf64Hplk Jun 24 10:01:22.946526 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Id: None Jun 24 10:01:22.946526 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Name: None Jun 24 10:01:22.946526 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Identity-Status: Confirmed Jun 24 10:01:22.946526 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Is-Admin-Project: True Jun 24 10:01:22.946526 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Id: default Jun 24 10:01:22.946526 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Name: Default Jun 24 10:01:22.946526 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Id: 5c63109cbb94476fac8c1ce04a931424 Jun 24 10:01:22.946526 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Name: tempest-VolumesNegativeTest-974724435 Jun 24 10:01:22.946526 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Role: reader,member Jun 24 10:01:22.946526 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Roles: reader,member Jun 24 10:01:22.947942 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5c63109cbb94476fac8c1ce04a931424"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5c63109cbb94476fac8c1ce04a931424", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c63109cbb94476fac8c1ce04a931424"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c63109cbb94476fac8c1ce04a931424"}]}] Jun 24 10:01:22.947942 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant: tempest-VolumesNegativeTest-974724435 Jun 24 10:01:22.947942 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Id: 5c63109cbb94476fac8c1ce04a931424 Jun 24 10:01:22.947942 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Name: tempest-VolumesNegativeTest-974724435 Jun 24 10:01:22.947942 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User: tempest-VolumesNegativeTest-974724435-project Jun 24 10:01:22.947942 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Id: default Jun 24 10:01:22.947942 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Name: Default Jun 24 10:01:22.947942 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Id: d9960b92b22b4645a2c5735119ebf547 Jun 24 10:01:22.947942 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Name: tempest-VolumesNegativeTest-974724435-project Jun 24 10:01:22.947942 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: method: Jun 24 10:01:22.947942 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: exception: Volume b64f846e-b818-4a4b-8030-ee38aed851c5 could not be found. Jun 24 10:01:22.947942 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: action_args: {'id': 'b64f846e-b818-4a4b-8030-ee38aed851c5'} Jun 24 10:01:22.947942 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:01:22.948809 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:22.948809 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:01:22.948809 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:01:22.948809 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 10:01:22.948809 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 10:01:22.948809 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 10:01:22.948809 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 10:01:22.948809 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 10:01:22.948809 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 10:01:22.948809 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 10:01:22.948809 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 10:01:22.948809 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:01:22.948809 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:01:22.948809 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:01:22.948809 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:01:22.948809 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b64f846e-b818-4a4b-8030-ee38aed851c5 could not be found. (HTTP 404) (Request-ID: req-88f3d4c2-b774-411e-9e23-337bcb2231ad) Jun 24 10:01:22.948809 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.948809 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:01:22.948809 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.949939 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:22.949939 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 10:01:22.949939 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 10:01:22.949939 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 10:01:22.949939 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 10:01:22.949939 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 10:01:22.949939 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 10:01:22.949939 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 10:01:22.949939 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 10:01:22.949939 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:01:22.949939 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:01:22.949939 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 10:01:22.949939 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 10:01:22.949939 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 10:01:22.949939 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 10:01:22.949939 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 10:01:22.949939 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 10:01:22.949939 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 10:01:22.949939 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 10:01:22.951543 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:01:22.951543 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:01:22.951543 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:01:22.951543 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:01:22.951543 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b64f846e-b818-4a4b-8030-ee38aed851c5 could not be found. Jun 24 10:01:22.951543 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.951543 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:01:22.951543 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.951543 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:22.951543 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:01:22.951543 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:01:22.951543 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:01:22.951543 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:01:22.951543 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:01:22.951543 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:01:22.951543 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:01:22.951543 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:01:22.951543 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 10:01:22.951543 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:01:22.952804 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b64f846e-b818-4a4b-8030-ee38aed851c5 could not be found. Jun 24 10:01:22.952804 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.952804 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:01:22.952804 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.952804 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:01:22.952804 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:01:22.952804 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:01:22.952804 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:01:22.952804 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:01:22.952804 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b64f846e-b818-4a4b-8030-ee38aed851c5 could not be found. Jun 24 10:01:22.952804 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:01:22.952804 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-062ac864-a4f7-467a-9247-069d9126f6ed tempest-VolumesNegativeTest-974724435 tempest-VolumesNegativeTest-974724435-project] Returning 404 to user: Volume b64f846e-b818-4a4b-8030-ee38aed851c5 could not be found. {{(pid=124980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:01:22.952804 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-062ac864-a4f7-467a-9247-069d9126f6ed tempest-VolumesNegativeTest-974724435 tempest-VolumesNegativeTest-974724435-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/b64f846e-b818-4a4b-8030-ee38aed851c5" status: 404 len: 109 microversion: 2.1 time: 0.079132 Jun 24 10:01:22.952804 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 32/72] 10.222.0.26 () {58 vars in 1244 bytes} [Fri Jun 24 10:01:22 2022] GET /compute/v2.1/os-volumes/b64f846e-b818-4a4b-8030-ee38aed851c5 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:01:23.175290 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-c5613a7f-8505-481c-b726-d250bada50ca tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:23.176087 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-c5613a7f-8505-481c-b726-d250bada50ca tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:23.190658 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c5613a7f-8505-481c-b726-d250bada50ca tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:23.191522 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c5613a7f-8505-481c-b726-d250bada50ca tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:23.192677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c5613a7f-8505-481c-b726-d250bada50ca tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:23.193268 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c5613a7f-8505-481c-b726-d250bada50ca tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:23.504866 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-69f9625b-3880-495b-8f52-8f732e45c973 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:23.505482 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-69f9625b-3880-495b-8f52-8f732e45c973 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:23.532136 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-69f9625b-3880-495b-8f52-8f732e45c973 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:23.532718 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-69f9625b-3880-495b-8f52-8f732e45c973 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:23.533550 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-69f9625b-3880-495b-8f52-8f732e45c973 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:23.533997 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-69f9625b-3880-495b-8f52-8f732e45c973 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:23.833178 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-69f9625b-3880-495b-8f52-8f732e45c973 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:23.845542 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-69f9625b-3880-495b-8f52-8f732e45c973 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1273 microversion: 2.1 time: 0.344897 Jun 24 10:01:23.849472 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 33/73] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:23 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1273 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:01:23.884808 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-0ff1adc0-1273-4189-9c9e-1b292e924d0d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:23.890996 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-0ff1adc0-1273-4189-9c9e-1b292e924d0d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:23.941504 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0ff1adc0-1273-4189-9c9e-1b292e924d0d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:23.942108 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0ff1adc0-1273-4189-9c9e-1b292e924d0d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:23.942952 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0ff1adc0-1273-4189-9c9e-1b292e924d0d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:23.943423 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0ff1adc0-1273-4189-9c9e-1b292e924d0d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:24.587783 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-0ff1adc0-1273-4189-9c9e-1b292e924d0d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:24.604851 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-0ff1adc0-1273-4189-9c9e-1b292e924d0d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1297 microversion: 2.1 time: 0.753632 Jun 24 10:01:24.606399 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 34/74] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:23 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1297 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:24.628266 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-e5580ebe-15b7-4b4b-b852-a6f86bfd61a9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:24.648907 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-e5580ebe-15b7-4b4b-b852-a6f86bfd61a9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:24.684784 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e5580ebe-15b7-4b4b-b852-a6f86bfd61a9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:24.684784 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e5580ebe-15b7-4b4b-b852-a6f86bfd61a9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:24.685346 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e5580ebe-15b7-4b4b-b852-a6f86bfd61a9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:24.685794 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e5580ebe-15b7-4b4b-b852-a6f86bfd61a9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:24.708244 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-c5613a7f-8505-481c-b726-d250bada50ca tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:24.731958 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-c5613a7f-8505-481c-b726-d250bada50ca tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1314 microversion: 2.1 time: 1.561157 Jun 24 10:01:24.741682 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 41/75] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:23 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1314 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:24.865648 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-99bd34be-00f4-4ae5-ab00-782bc95041fd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:24.866281 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-99bd34be-00f4-4ae5-ab00-782bc95041fd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:24.899226 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-99bd34be-00f4-4ae5-ab00-782bc95041fd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:24.899754 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-99bd34be-00f4-4ae5-ab00-782bc95041fd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:24.900615 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-99bd34be-00f4-4ae5-ab00-782bc95041fd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:24.911881 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-99bd34be-00f4-4ae5-ab00-782bc95041fd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:25.252858 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-99bd34be-00f4-4ae5-ab00-782bc95041fd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:25.261457 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-99bd34be-00f4-4ae5-ab00-782bc95041fd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1281 microversion: 2.1 time: 0.400239 Jun 24 10:01:25.262037 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 42/76] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:24 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1281 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:01:25.624610 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-9ff95893-bf26-46e8-b11c-8d3f0486ad71 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:25.625610 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-9ff95893-bf26-46e8-b11c-8d3f0486ad71 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:25.666513 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9ff95893-bf26-46e8-b11c-8d3f0486ad71 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:25.666513 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9ff95893-bf26-46e8-b11c-8d3f0486ad71 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:25.677514 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9ff95893-bf26-46e8-b11c-8d3f0486ad71 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:25.678798 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9ff95893-bf26-46e8-b11c-8d3f0486ad71 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:25.712096 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-e5580ebe-15b7-4b4b-b852-a6f86bfd61a9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:25.730050 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-e5580ebe-15b7-4b4b-b852-a6f86bfd61a9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:25.731935 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-e5580ebe-15b7-4b4b-b852-a6f86bfd61a9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:25.738276 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-e5580ebe-15b7-4b4b-b852-a6f86bfd61a9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1338 microversion: 2.20 time: 1.128257 Jun 24 10:01:25.739666 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 35/77] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:01:24 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1338 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:01:25.759337 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-cc950554-904b-4bb8-a052-9bc378d161d9 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:25.760383 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-cc950554-904b-4bb8-a052-9bc378d161d9 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:25.780901 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-cc950554-904b-4bb8-a052-9bc378d161d9 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:25.781862 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-cc950554-904b-4bb8-a052-9bc378d161d9 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:25.783148 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-cc950554-904b-4bb8-a052-9bc378d161d9 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:25.785361 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-cc950554-904b-4bb8-a052-9bc378d161d9 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:25.869288 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-9ff95893-bf26-46e8-b11c-8d3f0486ad71 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:25.879646 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-9ff95893-bf26-46e8-b11c-8d3f0486ad71 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1295 microversion: 2.1 time: 0.260198 Jun 24 10:01:25.880264 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 43/78] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:25 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1295 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:01:26.279484 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-9b4cc801-9893-41b5-a874-b8fb7ea6cc1a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:26.280322 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-9b4cc801-9893-41b5-a874-b8fb7ea6cc1a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:26.305776 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9b4cc801-9893-41b5-a874-b8fb7ea6cc1a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:26.306232 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9b4cc801-9893-41b5-a874-b8fb7ea6cc1a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:26.307015 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9b4cc801-9893-41b5-a874-b8fb7ea6cc1a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:26.307443 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9b4cc801-9893-41b5-a874-b8fb7ea6cc1a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:26.581295 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-9b4cc801-9893-41b5-a874-b8fb7ea6cc1a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:26.627506 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-9b4cc801-9893-41b5-a874-b8fb7ea6cc1a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1279 microversion: 2.1 time: 0.325594 Jun 24 10:01:26.629712 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 44/79] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:26 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1279 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:26.706097 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-cc950554-904b-4bb8-a052-9bc378d161d9 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:26.719263 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-cc950554-904b-4bb8-a052-9bc378d161d9 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1314 microversion: 2.1 time: 0.964220 Jun 24 10:01:26.731231 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 36/80] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:25 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1314 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:26.760666 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-374187d7-c125-4947-9b5e-109a0268cc3e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:26.761457 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-374187d7-c125-4947-9b5e-109a0268cc3e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:26.779271 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-374187d7-c125-4947-9b5e-109a0268cc3e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:26.786083 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-374187d7-c125-4947-9b5e-109a0268cc3e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:26.786891 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-374187d7-c125-4947-9b5e-109a0268cc3e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:26.787529 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-374187d7-c125-4947-9b5e-109a0268cc3e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:26.898528 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-73cd6ce6-c345-4d07-9812-1262226b97f2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:26.899242 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-73cd6ce6-c345-4d07-9812-1262226b97f2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:26.928687 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-73cd6ce6-c345-4d07-9812-1262226b97f2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:26.930886 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-73cd6ce6-c345-4d07-9812-1262226b97f2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:26.935592 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-73cd6ce6-c345-4d07-9812-1262226b97f2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:26.938408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-73cd6ce6-c345-4d07-9812-1262226b97f2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:27.241492 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-374187d7-c125-4947-9b5e-109a0268cc3e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:27.252802 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-374187d7-c125-4947-9b5e-109a0268cc3e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:27.254967 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-374187d7-c125-4947-9b5e-109a0268cc3e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:27.256543 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-374187d7-c125-4947-9b5e-109a0268cc3e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1338 microversion: 2.20 time: 0.500115 Jun 24 10:01:27.269288 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 45/81] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:01:26 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1338 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:01:27.499537 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-d7bf22dc-5a71-4dbd-857b-4066872ae8de req-1c9f0bc5-ae84-4057-9d8d-f85ee1f419b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffd6d45e-4648-4b13-acb5-3473bf9e935a", "tag": "ac909eb0-aeea-4b66-970c-1e6b004e8902"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:01:27.522320 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-d7bf22dc-5a71-4dbd-857b-4066872ae8de req-1c9f0bc5-ae84-4057-9d8d-f85ee1f419b5 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:27.522768 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-d7bf22dc-5a71-4dbd-857b-4066872ae8de req-1c9f0bc5-ae84-4057-9d8d-f85ee1f419b5 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:27.591360 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-d7bf22dc-5a71-4dbd-857b-4066872ae8de req-1c9f0bc5-ae84-4057-9d8d-f85ee1f419b5 service nova] Creating event network-changed:ac909eb0-aeea-4b66-970c-1e6b004e8902 for instance ffd6d45e-4648-4b13-acb5-3473bf9e935a on hv-cinder-84327 Jun 24 10:01:27.594969 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-d7bf22dc-5a71-4dbd-857b-4066872ae8de req-1c9f0bc5-ae84-4057-9d8d-f85ee1f419b5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124979) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 24 10:01:27.639943 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-be67c01e-af14-48be-a109-47a803af5823 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.038s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:27.641714 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-be67c01e-af14-48be-a109-47a803af5823 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:27.643239 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-73cd6ce6-c345-4d07-9812-1262226b97f2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:27.647005 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-be67c01e-af14-48be-a109-47a803af5823 None None] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:27.647497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-be67c01e-af14-48be-a109-47a803af5823 None None] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:27.662988 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-73cd6ce6-c345-4d07-9812-1262226b97f2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1295 microversion: 2.1 time: 0.767441 Jun 24 10:01:27.693877 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 37/82] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:26 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1295 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:01:27.694012 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.compute.rpcapi [None req-be67c01e-af14-48be-a109-47a803af5823 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 24 10:01:27.696327 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-be67c01e-af14-48be-a109-47a803af5823 None None] Releasing lock "compute-rpcapi-router" {{(pid=124979) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 24 10:01:27.705062 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-9d86cdcf-511a-4731-bd58-251401eae366 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:27.705691 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-9d86cdcf-511a-4731-bd58-251401eae366 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:27.731437 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9d86cdcf-511a-4731-bd58-251401eae366 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:27.736975 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9d86cdcf-511a-4731-bd58-251401eae366 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:27.749856 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9d86cdcf-511a-4731-bd58-251401eae366 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:27.750425 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9d86cdcf-511a-4731-bd58-251401eae366 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:27.771133 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-be67c01e-af14-48be-a109-47a803af5823 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.499408 Jun 24 10:01:27.771706 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 46/83] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:27.778023 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-3de4be99-c2e0-4454-8abd-4992b2029be7 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:27.788264 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-3de4be99-c2e0-4454-8abd-4992b2029be7 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:27.807821 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3de4be99-c2e0-4454-8abd-4992b2029be7 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:27.808322 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3de4be99-c2e0-4454-8abd-4992b2029be7 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:27.809113 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3de4be99-c2e0-4454-8abd-4992b2029be7 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:27.812790 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3de4be99-c2e0-4454-8abd-4992b2029be7 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:28.199373 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-9d86cdcf-511a-4731-bd58-251401eae366 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:28.223217 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-9d86cdcf-511a-4731-bd58-251401eae366 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1279 microversion: 2.1 time: 0.528950 Jun 24 10:01:28.227385 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 38/84] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:27 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1279 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:28.278052 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-d48768c6-36ce-455b-a46e-d367821a5c60 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:28.279103 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-d48768c6-36ce-455b-a46e-d367821a5c60 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:28.284693 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:01:28.290934 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d48768c6-36ce-455b-a46e-d367821a5c60 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:28.291535 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d48768c6-36ce-455b-a46e-d367821a5c60 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:28.293019 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d48768c6-36ce-455b-a46e-d367821a5c60 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:28.293612 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d48768c6-36ce-455b-a46e-d367821a5c60 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:28.510446 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-3de4be99-c2e0-4454-8abd-4992b2029be7 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:28.518451 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-3de4be99-c2e0-4454-8abd-4992b2029be7 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1314 microversion: 2.1 time: 0.745349 Jun 24 10:01:28.528076 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 47/85] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:27 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1314 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:28.671488 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d48768c6-36ce-455b-a46e-d367821a5c60 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:28.684260 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-774be730-9ee3-48e3-8a10-8262fcc4ffb7 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:28.685085 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-774be730-9ee3-48e3-8a10-8262fcc4ffb7 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:28.692498 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d48768c6-36ce-455b-a46e-d367821a5c60 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:28.694219 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d48768c6-36ce-455b-a46e-d367821a5c60 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:28.700528 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-774be730-9ee3-48e3-8a10-8262fcc4ffb7 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:28.701268 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-774be730-9ee3-48e3-8a10-8262fcc4ffb7 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:28.702208 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-774be730-9ee3-48e3-8a10-8262fcc4ffb7 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:28.702796 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-774be730-9ee3-48e3-8a10-8262fcc4ffb7 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:28.705392 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-d48768c6-36ce-455b-a46e-d367821a5c60 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1338 microversion: 2.20 time: 0.431189 Jun 24 10:01:28.705988 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 39/86] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:01:28 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1338 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:01:28.871228 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-774be730-9ee3-48e3-8a10-8262fcc4ffb7 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:28.881016 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-774be730-9ee3-48e3-8a10-8262fcc4ffb7 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1295 microversion: 2.1 time: 0.200439 Jun 24 10:01:28.881580 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 48/87] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:28 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1295 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:01:29.248053 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-4c2704c8-b64b-4880-ad8b-29488aca0504 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:29.251878 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-4c2704c8-b64b-4880-ad8b-29488aca0504 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:29.256222 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell0:SELECT=6 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:01:29.308829 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4c2704c8-b64b-4880-ad8b-29488aca0504 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:29.309579 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4c2704c8-b64b-4880-ad8b-29488aca0504 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:29.318411 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4c2704c8-b64b-4880-ad8b-29488aca0504 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:29.318411 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4c2704c8-b64b-4880-ad8b-29488aca0504 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:29.546670 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-fa97d406-4060-4463-bcf2-70d56962ea7c tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:29.547423 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-fa97d406-4060-4463-bcf2-70d56962ea7c tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:29.549891 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell0:SELECT=22 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:01:29.581405 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fa97d406-4060-4463-bcf2-70d56962ea7c tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:29.581405 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fa97d406-4060-4463-bcf2-70d56962ea7c tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:29.581405 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fa97d406-4060-4463-bcf2-70d56962ea7c tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:29.581405 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fa97d406-4060-4463-bcf2-70d56962ea7c tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:30.144502 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-fa97d406-4060-4463-bcf2-70d56962ea7c tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:30.161541 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-fa97d406-4060-4463-bcf2-70d56962ea7c tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1314 microversion: 2.1 time: 0.619429 Jun 24 10:01:30.162452 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 49/88] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:29 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1314 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:01:30.168049 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-de17b0c9-6181-4c2e-871b-2beab36a4681 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:30.168704 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-de17b0c9-6181-4c2e-871b-2beab36a4681 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:30.177553 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-4c2704c8-b64b-4880-ad8b-29488aca0504 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:30.187116 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-4c2704c8-b64b-4880-ad8b-29488aca0504 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1279 microversion: 2.1 time: 0.947000 Jun 24 10:01:30.196865 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 40/89] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:29 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1279 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:30.201875 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-fcb9f820-a7be-438c-a217-7503be6e2634 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:30.202494 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-fcb9f820-a7be-438c-a217-7503be6e2634 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:30.206009 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-de17b0c9-6181-4c2e-871b-2beab36a4681 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:30.206715 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-de17b0c9-6181-4c2e-871b-2beab36a4681 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:30.207690 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-de17b0c9-6181-4c2e-871b-2beab36a4681 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:30.208315 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-de17b0c9-6181-4c2e-871b-2beab36a4681 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:30.253969 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-fcb9f820-a7be-438c-a217-7503be6e2634 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:30.254610 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-fcb9f820-a7be-438c-a217-7503be6e2634 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:30.255270 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-fcb9f820-a7be-438c-a217-7503be6e2634 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:30.260352 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-fcb9f820-a7be-438c-a217-7503be6e2634 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:30.501185 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-fcb9f820-a7be-438c-a217-7503be6e2634 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:30.512288 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-fcb9f820-a7be-438c-a217-7503be6e2634 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1295 microversion: 2.1 time: 0.312989 Jun 24 10:01:30.512288 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 41/90] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:30 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1295 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:30.640323 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-de17b0c9-6181-4c2e-871b-2beab36a4681 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:30.649208 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-de17b0c9-6181-4c2e-871b-2beab36a4681 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:30.650753 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-de17b0c9-6181-4c2e-871b-2beab36a4681 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:30.657978 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-de17b0c9-6181-4c2e-871b-2beab36a4681 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1405 microversion: 2.20 time: 0.494444 Jun 24 10:01:30.674843 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 50/91] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:01:30 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1405 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:01:31.186885 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-ea5d26cf-83ab-41ab-ab7e-c8b16738645e tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:31.189779 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-ea5d26cf-83ab-41ab-ab7e-c8b16738645e tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:31.196098 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell0:SELECT=30 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:01:31.206761 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-3e1a90b9-e457-4fdc-b04c-5bb7a363d74a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:31.208310 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-3e1a90b9-e457-4fdc-b04c-5bb7a363d74a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:31.233547 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3e1a90b9-e457-4fdc-b04c-5bb7a363d74a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:31.234269 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3e1a90b9-e457-4fdc-b04c-5bb7a363d74a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:31.234551 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ea5d26cf-83ab-41ab-ab7e-c8b16738645e tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:31.236881 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3e1a90b9-e457-4fdc-b04c-5bb7a363d74a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:31.237241 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ea5d26cf-83ab-41ab-ab7e-c8b16738645e tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:31.238561 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ea5d26cf-83ab-41ab-ab7e-c8b16738645e tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:31.240351 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ea5d26cf-83ab-41ab-ab7e-c8b16738645e tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:31.240574 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3e1a90b9-e457-4fdc-b04c-5bb7a363d74a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:31.359460 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-3e1a90b9-e457-4fdc-b04c-5bb7a363d74a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:31.379538 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-3e1a90b9-e457-4fdc-b04c-5bb7a363d74a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1279 microversion: 2.1 time: 0.174707 Jun 24 10:01:31.383612 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 51/92] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:31 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1279 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:31.527482 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-7953b2b8-67e6-48fd-82e3-ff1e87d9074a tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:31.528494 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-7953b2b8-67e6-48fd-82e3-ff1e87d9074a tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:31.535070 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7953b2b8-67e6-48fd-82e3-ff1e87d9074a tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:31.535527 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7953b2b8-67e6-48fd-82e3-ff1e87d9074a tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:31.550059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7953b2b8-67e6-48fd-82e3-ff1e87d9074a tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:31.550816 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7953b2b8-67e6-48fd-82e3-ff1e87d9074a tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:31.582472 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=100 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:01:31.896496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-ea5d26cf-83ab-41ab-ab7e-c8b16738645e tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:31.907172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-ea5d26cf-83ab-41ab-ab7e-c8b16738645e tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1314 microversion: 2.1 time: 0.729756 Jun 24 10:01:31.908222 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 42/93] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:31 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1314 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:31.927026 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-82811de3-8b0d-45b2-9392-505340b6b53d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:31.927896 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-82811de3-8b0d-45b2-9392-505340b6b53d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:31.935570 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-82811de3-8b0d-45b2-9392-505340b6b53d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:31.936520 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-82811de3-8b0d-45b2-9392-505340b6b53d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:31.937639 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-82811de3-8b0d-45b2-9392-505340b6b53d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:31.938239 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-82811de3-8b0d-45b2-9392-505340b6b53d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:31.945939 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-7953b2b8-67e6-48fd-82e3-ff1e87d9074a tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:31.955258 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-7953b2b8-67e6-48fd-82e3-ff1e87d9074a tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1362 microversion: 2.1 time: 0.432336 Jun 24 10:01:31.960706 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 52/94] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:31 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1362 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:01:32.199157 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-db7d5466-0feb-4ebf-a833-46be39ce0339 req-c919ba15-80e8-4949-9515-97ccc48e9328 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6", "tag": "be1d3537-038c-4ba5-84f5-566839e929b4"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:01:32.213393 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-db7d5466-0feb-4ebf-a833-46be39ce0339 req-c919ba15-80e8-4949-9515-97ccc48e9328 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:32.214030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-db7d5466-0feb-4ebf-a833-46be39ce0339 req-c919ba15-80e8-4949-9515-97ccc48e9328 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:32.234494 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-db7d5466-0feb-4ebf-a833-46be39ce0339 req-c919ba15-80e8-4949-9515-97ccc48e9328 service nova] Creating event network-changed:be1d3537-038c-4ba5-84f5-566839e929b4 for instance ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 on hv-cinder-84327 Jun 24 10:01:32.253682 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-db7d5466-0feb-4ebf-a833-46be39ce0339 req-c919ba15-80e8-4949-9515-97ccc48e9328 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.290321 Jun 24 10:01:32.255109 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 53/95] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:32.273801 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-82811de3-8b0d-45b2-9392-505340b6b53d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:32.284667 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-82811de3-8b0d-45b2-9392-505340b6b53d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:32.286967 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-82811de3-8b0d-45b2-9392-505340b6b53d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:32.288494 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-82811de3-8b0d-45b2-9392-505340b6b53d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1405 microversion: 2.20 time: 0.378988 Jun 24 10:01:32.289211 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 43/96] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:01:31 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1405 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:01:32.399150 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-36f0c8a8-8d30-4d73-ba1e-2847e6dd7c95 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:32.399875 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-36f0c8a8-8d30-4d73-ba1e-2847e6dd7c95 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:32.406411 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-36f0c8a8-8d30-4d73-ba1e-2847e6dd7c95 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:32.406977 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-36f0c8a8-8d30-4d73-ba1e-2847e6dd7c95 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:32.407745 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-36f0c8a8-8d30-4d73-ba1e-2847e6dd7c95 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:32.408213 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-36f0c8a8-8d30-4d73-ba1e-2847e6dd7c95 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:32.573229 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-36f0c8a8-8d30-4d73-ba1e-2847e6dd7c95 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:32.583434 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-36f0c8a8-8d30-4d73-ba1e-2847e6dd7c95 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1321 microversion: 2.1 time: 0.188100 Jun 24 10:01:32.584927 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 54/97] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:32 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:32.924901 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-e3cf468f-a7a7-41ac-93e2-e88094e56669 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:32.925521 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-e3cf468f-a7a7-41ac-93e2-e88094e56669 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:32.931942 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e3cf468f-a7a7-41ac-93e2-e88094e56669 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:32.932438 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e3cf468f-a7a7-41ac-93e2-e88094e56669 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:32.933208 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e3cf468f-a7a7-41ac-93e2-e88094e56669 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:32.933775 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e3cf468f-a7a7-41ac-93e2-e88094e56669 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:32.978041 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-3b4f33a8-7b29-4c79-b887-21abf47d7ddf tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:32.978680 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-3b4f33a8-7b29-4c79-b887-21abf47d7ddf tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:32.984806 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3b4f33a8-7b29-4c79-b887-21abf47d7ddf tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:32.985260 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3b4f33a8-7b29-4c79-b887-21abf47d7ddf tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:32.986034 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3b4f33a8-7b29-4c79-b887-21abf47d7ddf tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:32.986474 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3b4f33a8-7b29-4c79-b887-21abf47d7ddf tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:33.080968 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-e3cf468f-a7a7-41ac-93e2-e88094e56669 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:33.105957 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-e3cf468f-a7a7-41ac-93e2-e88094e56669 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1314 microversion: 2.1 time: 0.185117 Jun 24 10:01:33.119245 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 44/98] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:32 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:33.139252 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-3b4f33a8-7b29-4c79-b887-21abf47d7ddf tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:33.145562 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-3b4f33a8-7b29-4c79-b887-21abf47d7ddf tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1362 microversion: 2.1 time: 0.172065 Jun 24 10:01:33.152163 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 55/99] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:32 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:01:33.306904 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-1ca8805b-fa27-4339-9a3a-d926fa273d95 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:33.307518 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-1ca8805b-fa27-4339-9a3a-d926fa273d95 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:33.317017 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1ca8805b-fa27-4339-9a3a-d926fa273d95 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:33.317474 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1ca8805b-fa27-4339-9a3a-d926fa273d95 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:33.318255 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1ca8805b-fa27-4339-9a3a-d926fa273d95 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:33.318699 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1ca8805b-fa27-4339-9a3a-d926fa273d95 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:33.341212 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=100 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:01:33.454689 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-1ca8805b-fa27-4339-9a3a-d926fa273d95 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:33.462409 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-1ca8805b-fa27-4339-9a3a-d926fa273d95 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:33.463901 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-1ca8805b-fa27-4339-9a3a-d926fa273d95 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:33.465026 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-1ca8805b-fa27-4339-9a3a-d926fa273d95 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1405 microversion: 2.20 time: 0.162007 Jun 24 10:01:33.465578 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 45/100] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:01:33 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:01:33.602078 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-f8f5ce4f-f416-487b-b36f-58169db84035 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:33.602766 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-f8f5ce4f-f416-487b-b36f-58169db84035 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:33.608944 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f8f5ce4f-f416-487b-b36f-58169db84035 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:33.609389 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f8f5ce4f-f416-487b-b36f-58169db84035 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:33.610145 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f8f5ce4f-f416-487b-b36f-58169db84035 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:33.610675 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f8f5ce4f-f416-487b-b36f-58169db84035 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:33.766903 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-f8f5ce4f-f416-487b-b36f-58169db84035 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:33.781365 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-f8f5ce4f-f416-487b-b36f-58169db84035 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1321 microversion: 2.1 time: 0.181607 Jun 24 10:01:33.781365 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 56/101] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:33 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:34.125559 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-5f088e72-318d-4997-a206-3b11dacb1296 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:34.127020 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-5f088e72-318d-4997-a206-3b11dacb1296 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:34.133451 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5f088e72-318d-4997-a206-3b11dacb1296 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:34.133836 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5f088e72-318d-4997-a206-3b11dacb1296 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:34.134604 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5f088e72-318d-4997-a206-3b11dacb1296 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:34.135041 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5f088e72-318d-4997-a206-3b11dacb1296 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:34.170912 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-878f3afd-bedc-480b-8bff-a2901315ebfe tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:34.174517 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-878f3afd-bedc-480b-8bff-a2901315ebfe tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:34.185824 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:01:34.188638 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-878f3afd-bedc-480b-8bff-a2901315ebfe tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:34.189630 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-878f3afd-bedc-480b-8bff-a2901315ebfe tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:34.190949 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-878f3afd-bedc-480b-8bff-a2901315ebfe tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:34.191579 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-878f3afd-bedc-480b-8bff-a2901315ebfe tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:34.400925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-878f3afd-bedc-480b-8bff-a2901315ebfe tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:34.413905 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-878f3afd-bedc-480b-8bff-a2901315ebfe tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1362 microversion: 2.1 time: 0.251335 Jun 24 10:01:34.415879 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 57/102] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:34 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:34.422047 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-9c974c58-5739-4a75-a042-7aaa90eb4b65 req-f692492c-8aeb-47fb-be3f-d2aaf1970adb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "904eb348-521e-499e-8127-cb3096230877", "tag": "bc68c0d7-3cc3-4add-8d35-8b1892ac129e"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:01:34.443965 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-9c974c58-5739-4a75-a042-7aaa90eb4b65 req-f692492c-8aeb-47fb-be3f-d2aaf1970adb service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:34.446043 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-9c974c58-5739-4a75-a042-7aaa90eb4b65 req-f692492c-8aeb-47fb-be3f-d2aaf1970adb service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:34.464646 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-5f088e72-318d-4997-a206-3b11dacb1296 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:34.472693 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-5f088e72-318d-4997-a206-3b11dacb1296 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1314 microversion: 2.1 time: 0.351366 Jun 24 10:01:34.474847 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-9c974c58-5739-4a75-a042-7aaa90eb4b65 req-f692492c-8aeb-47fb-be3f-d2aaf1970adb service nova] Creating event network-changed:bc68c0d7-3cc3-4add-8d35-8b1892ac129e for instance 904eb348-521e-499e-8127-cb3096230877 on hv-cinder-84327 Jun 24 10:01:34.476840 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 46/103] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:34 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:34.485949 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-28a3a850-a685-49d5-817c-21e588906377 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:34.486562 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-28a3a850-a685-49d5-817c-21e588906377 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:34.488518 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-9c974c58-5739-4a75-a042-7aaa90eb4b65 req-f692492c-8aeb-47fb-be3f-d2aaf1970adb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068013 Jun 24 10:01:34.489435 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 58/104] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:34.495325 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-28a3a850-a685-49d5-817c-21e588906377 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:34.495853 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-28a3a850-a685-49d5-817c-21e588906377 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:34.496682 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-28a3a850-a685-49d5-817c-21e588906377 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:34.497306 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-28a3a850-a685-49d5-817c-21e588906377 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:34.671605 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-28a3a850-a685-49d5-817c-21e588906377 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:34.681787 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-28a3a850-a685-49d5-817c-21e588906377 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:34.683030 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-28a3a850-a685-49d5-817c-21e588906377 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:34.684478 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-28a3a850-a685-49d5-817c-21e588906377 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1405 microversion: 2.20 time: 0.203451 Jun 24 10:01:34.685250 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 47/105] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:01:34 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1405 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:01:34.798490 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-df8fd85f-5124-4e61-9858-df628cbc6dc7 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:34.799420 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-df8fd85f-5124-4e61-9858-df628cbc6dc7 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:34.817158 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-df8fd85f-5124-4e61-9858-df628cbc6dc7 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:34.823059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-df8fd85f-5124-4e61-9858-df628cbc6dc7 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:34.826823 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-df8fd85f-5124-4e61-9858-df628cbc6dc7 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:34.827589 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-df8fd85f-5124-4e61-9858-df628cbc6dc7 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:35.105575 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-df8fd85f-5124-4e61-9858-df628cbc6dc7 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:35.118698 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-df8fd85f-5124-4e61-9858-df628cbc6dc7 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1321 microversion: 2.1 time: 0.324458 Jun 24 10:01:35.119396 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 59/106] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:34 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1321 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:35.433123 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-05e57b89-b910-42be-bd5b-1d55d2998885 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:35.433746 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-05e57b89-b910-42be-bd5b-1d55d2998885 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:35.448423 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-05e57b89-b910-42be-bd5b-1d55d2998885 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:35.449527 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-05e57b89-b910-42be-bd5b-1d55d2998885 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:35.450493 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-05e57b89-b910-42be-bd5b-1d55d2998885 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:35.451149 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-05e57b89-b910-42be-bd5b-1d55d2998885 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:35.512506 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-588269b3-59a3-4af6-9113-52094c71fcf4 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:35.515851 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-588269b3-59a3-4af6-9113-52094c71fcf4 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:35.531160 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-588269b3-59a3-4af6-9113-52094c71fcf4 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:35.531611 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-588269b3-59a3-4af6-9113-52094c71fcf4 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:35.533595 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-588269b3-59a3-4af6-9113-52094c71fcf4 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:35.533595 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-588269b3-59a3-4af6-9113-52094c71fcf4 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:35.742255 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-588269b3-59a3-4af6-9113-52094c71fcf4 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:35.752456 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-05e57b89-b910-42be-bd5b-1d55d2998885 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:35.760664 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-05e57b89-b910-42be-bd5b-1d55d2998885 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1362 microversion: 2.1 time: 0.332035 Jun 24 10:01:35.761810 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-588269b3-59a3-4af6-9113-52094c71fcf4 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1314 microversion: 2.1 time: 0.262534 Jun 24 10:01:35.764110 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 60/107] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:35 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:35.779441 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 48/108] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:35 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1362 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:35.779577 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-71cf2254-0922-4dce-9ea9-a917b463ff6b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:35.779577 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-71cf2254-0922-4dce-9ea9-a917b463ff6b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:35.794397 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-71cf2254-0922-4dce-9ea9-a917b463ff6b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:35.794858 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-71cf2254-0922-4dce-9ea9-a917b463ff6b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:35.795644 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-71cf2254-0922-4dce-9ea9-a917b463ff6b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:35.796085 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-71cf2254-0922-4dce-9ea9-a917b463ff6b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:36.015237 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-71cf2254-0922-4dce-9ea9-a917b463ff6b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:36.025455 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-71cf2254-0922-4dce-9ea9-a917b463ff6b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:36.026951 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-71cf2254-0922-4dce-9ea9-a917b463ff6b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:36.028301 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-71cf2254-0922-4dce-9ea9-a917b463ff6b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1405 microversion: 2.20 time: 0.263183 Jun 24 10:01:36.029004 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 61/109] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:01:35 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1405 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:01:36.136847 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-cfde9382-7c31-440b-b6ee-7b089e3e2cd6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:36.137758 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-cfde9382-7c31-440b-b6ee-7b089e3e2cd6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:36.143907 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-cfde9382-7c31-440b-b6ee-7b089e3e2cd6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:36.144601 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-cfde9382-7c31-440b-b6ee-7b089e3e2cd6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:36.145559 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-cfde9382-7c31-440b-b6ee-7b089e3e2cd6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:36.146355 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-cfde9382-7c31-440b-b6ee-7b089e3e2cd6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:36.372028 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-cfde9382-7c31-440b-b6ee-7b089e3e2cd6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:36.384682 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-cfde9382-7c31-440b-b6ee-7b089e3e2cd6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1321 microversion: 2.1 time: 0.252419 Jun 24 10:01:36.385647 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 49/110] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:36 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:36.781173 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-baca814d-9995-4fd7-bc28-079f5a1859c1 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:36.781876 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-baca814d-9995-4fd7-bc28-079f5a1859c1 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:36.794820 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-baca814d-9995-4fd7-bc28-079f5a1859c1 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:36.795230 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-7d58d533-dd03-4a43-bb23-b3473086a2f2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:36.795707 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-baca814d-9995-4fd7-bc28-079f5a1859c1 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:36.796524 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-baca814d-9995-4fd7-bc28-079f5a1859c1 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:36.796944 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-7d58d533-dd03-4a43-bb23-b3473086a2f2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:36.797072 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-baca814d-9995-4fd7-bc28-079f5a1859c1 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:36.804150 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7d58d533-dd03-4a43-bb23-b3473086a2f2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:36.804840 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7d58d533-dd03-4a43-bb23-b3473086a2f2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:36.805813 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7d58d533-dd03-4a43-bb23-b3473086a2f2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:36.806403 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7d58d533-dd03-4a43-bb23-b3473086a2f2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:36.990644 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-7d58d533-dd03-4a43-bb23-b3473086a2f2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:37.002877 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-7d58d533-dd03-4a43-bb23-b3473086a2f2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1362 microversion: 2.1 time: 0.212000 Jun 24 10:01:37.003725 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 50/111] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:36 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:01:37.051041 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-2713c917-4ea9-43f3-b240-a8621cd54e1c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:37.052110 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-2713c917-4ea9-43f3-b240-a8621cd54e1c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:37.064607 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2713c917-4ea9-43f3-b240-a8621cd54e1c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:37.065305 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2713c917-4ea9-43f3-b240-a8621cd54e1c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:37.066424 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2713c917-4ea9-43f3-b240-a8621cd54e1c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:37.069860 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2713c917-4ea9-43f3-b240-a8621cd54e1c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:37.084999 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-baca814d-9995-4fd7-bc28-079f5a1859c1 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:37.104075 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-baca814d-9995-4fd7-bc28-079f5a1859c1 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1314 microversion: 2.1 time: 0.326683 Jun 24 10:01:37.106195 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 62/112] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:36 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:01:37.292549 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2713c917-4ea9-43f3-b240-a8621cd54e1c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:37.300810 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2713c917-4ea9-43f3-b240-a8621cd54e1c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:37.302406 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2713c917-4ea9-43f3-b240-a8621cd54e1c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:37.303591 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-2713c917-4ea9-43f3-b240-a8621cd54e1c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1405 microversion: 2.20 time: 0.258067 Jun 24 10:01:37.315522 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 51/113] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:01:37 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1405 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:01:37.414075 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-5cc971dd-cf08-4b91-ad07-e681a44a4c3c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:37.414723 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-5cc971dd-cf08-4b91-ad07-e681a44a4c3c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:37.424345 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5cc971dd-cf08-4b91-ad07-e681a44a4c3c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:37.424345 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5cc971dd-cf08-4b91-ad07-e681a44a4c3c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:37.424345 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5cc971dd-cf08-4b91-ad07-e681a44a4c3c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:37.424345 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5cc971dd-cf08-4b91-ad07-e681a44a4c3c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:37.586573 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-5cc971dd-cf08-4b91-ad07-e681a44a4c3c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:37.596358 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-5cc971dd-cf08-4b91-ad07-e681a44a4c3c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1321 microversion: 2.1 time: 0.186041 Jun 24 10:01:37.597596 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 63/114] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:37 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:01:38.019609 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-7d1a87a1-1933-415d-b897-71036c09bab6 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:38.020230 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-7d1a87a1-1933-415d-b897-71036c09bab6 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:38.028384 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7d1a87a1-1933-415d-b897-71036c09bab6 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:38.029129 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7d1a87a1-1933-415d-b897-71036c09bab6 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:38.030073 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7d1a87a1-1933-415d-b897-71036c09bab6 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:38.030798 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7d1a87a1-1933-415d-b897-71036c09bab6 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:38.125875 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-99fda3de-bfb5-4c93-8fc2-0a9a3b36a179 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:38.127253 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-99fda3de-bfb5-4c93-8fc2-0a9a3b36a179 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:38.129428 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell0:SELECT=6 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:01:38.149627 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-99fda3de-bfb5-4c93-8fc2-0a9a3b36a179 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:38.150186 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-99fda3de-bfb5-4c93-8fc2-0a9a3b36a179 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:38.151163 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-99fda3de-bfb5-4c93-8fc2-0a9a3b36a179 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:38.151746 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-99fda3de-bfb5-4c93-8fc2-0a9a3b36a179 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:38.187331 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-7d1a87a1-1933-415d-b897-71036c09bab6 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:38.195751 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-7d1a87a1-1933-415d-b897-71036c09bab6 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1362 microversion: 2.1 time: 0.180346 Jun 24 10:01:38.202234 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 52/115] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:38 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:38.315800 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-99fda3de-bfb5-4c93-8fc2-0a9a3b36a179 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:38.323106 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-c952bfa9-56dd-4064-b47b-aad4274cfb73 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:38.323468 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-99fda3de-bfb5-4c93-8fc2-0a9a3b36a179 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1314 microversion: 2.1 time: 0.201825 Jun 24 10:01:38.323722 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-c952bfa9-56dd-4064-b47b-aad4274cfb73 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:38.324038 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 64/116] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:38 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:38.329772 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c952bfa9-56dd-4064-b47b-aad4274cfb73 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:38.336968 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c952bfa9-56dd-4064-b47b-aad4274cfb73 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:38.336968 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c952bfa9-56dd-4064-b47b-aad4274cfb73 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:38.336968 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c952bfa9-56dd-4064-b47b-aad4274cfb73 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:38.463856 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-c952bfa9-56dd-4064-b47b-aad4274cfb73 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:38.471913 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-c952bfa9-56dd-4064-b47b-aad4274cfb73 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:38.473456 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-c952bfa9-56dd-4064-b47b-aad4274cfb73 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:38.474554 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-c952bfa9-56dd-4064-b47b-aad4274cfb73 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1405 microversion: 2.20 time: 0.155777 Jun 24 10:01:38.475280 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 53/117] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:01:38 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:01:38.612561 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-2b5f2b3b-3b7f-4788-8e7f-95cbb66ac544 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:38.613180 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-2b5f2b3b-3b7f-4788-8e7f-95cbb66ac544 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:38.619470 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2b5f2b3b-3b7f-4788-8e7f-95cbb66ac544 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:38.619920 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2b5f2b3b-3b7f-4788-8e7f-95cbb66ac544 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:38.620952 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2b5f2b3b-3b7f-4788-8e7f-95cbb66ac544 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:38.621341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2b5f2b3b-3b7f-4788-8e7f-95cbb66ac544 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:38.751219 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-2b5f2b3b-3b7f-4788-8e7f-95cbb66ac544 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:38.759195 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-2b5f2b3b-3b7f-4788-8e7f-95cbb66ac544 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1321 microversion: 2.1 time: 0.150971 Jun 24 10:01:38.763272 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 65/118] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:38 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:39.212610 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-46ddebd6-5137-438b-b96c-7199b0846fd1 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:39.213220 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-46ddebd6-5137-438b-b96c-7199b0846fd1 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:39.219167 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-46ddebd6-5137-438b-b96c-7199b0846fd1 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:39.219611 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-46ddebd6-5137-438b-b96c-7199b0846fd1 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:39.220388 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-46ddebd6-5137-438b-b96c-7199b0846fd1 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:39.220818 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-46ddebd6-5137-438b-b96c-7199b0846fd1 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:39.340573 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-729f3833-86b0-4ea0-9f2c-ff1e1427fb49 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:39.341901 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-729f3833-86b0-4ea0-9f2c-ff1e1427fb49 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:39.351131 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-729f3833-86b0-4ea0-9f2c-ff1e1427fb49 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:39.351131 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-729f3833-86b0-4ea0-9f2c-ff1e1427fb49 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:39.351419 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-46ddebd6-5137-438b-b96c-7199b0846fd1 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:39.351544 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-729f3833-86b0-4ea0-9f2c-ff1e1427fb49 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:39.351544 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-729f3833-86b0-4ea0-9f2c-ff1e1427fb49 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:39.357884 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-46ddebd6-5137-438b-b96c-7199b0846fd1 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1362 microversion: 2.1 time: 0.149128 Jun 24 10:01:39.358448 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 54/119] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:39 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:39.476567 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-729f3833-86b0-4ea0-9f2c-ff1e1427fb49 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:39.483895 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-729f3833-86b0-4ea0-9f2c-ff1e1427fb49 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1314 microversion: 2.1 time: 0.147177 Jun 24 10:01:39.484492 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 66/120] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:39 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:01:39.493079 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-8d14aedf-4d4f-42c6-8085-bed743685869 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:39.493682 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-8d14aedf-4d4f-42c6-8085-bed743685869 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:39.499561 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8d14aedf-4d4f-42c6-8085-bed743685869 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:39.500103 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8d14aedf-4d4f-42c6-8085-bed743685869 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:39.500892 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8d14aedf-4d4f-42c6-8085-bed743685869 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:39.501323 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8d14aedf-4d4f-42c6-8085-bed743685869 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:39.629298 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-8d14aedf-4d4f-42c6-8085-bed743685869 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:39.636567 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-8d14aedf-4d4f-42c6-8085-bed743685869 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:39.638050 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-8d14aedf-4d4f-42c6-8085-bed743685869 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:39.639135 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-8d14aedf-4d4f-42c6-8085-bed743685869 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1405 microversion: 2.20 time: 0.150741 Jun 24 10:01:39.639681 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 55/121] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:01:39 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:01:39.776414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-cab968b7-9c1b-4d77-9633-998c18e7a8ad tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:39.776938 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-cab968b7-9c1b-4d77-9633-998c18e7a8ad tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:39.782996 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-cab968b7-9c1b-4d77-9633-998c18e7a8ad tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:39.783453 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-cab968b7-9c1b-4d77-9633-998c18e7a8ad tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:39.784268 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-cab968b7-9c1b-4d77-9633-998c18e7a8ad tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:39.784720 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-cab968b7-9c1b-4d77-9633-998c18e7a8ad tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:39.912670 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-cab968b7-9c1b-4d77-9633-998c18e7a8ad tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:39.920953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-cab968b7-9c1b-4d77-9633-998c18e7a8ad tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1321 microversion: 2.1 time: 0.148973 Jun 24 10:01:39.921518 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 67/122] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:39 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:40.375263 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-2afc8d24-029a-408a-9be3-bbd8ec28d27b tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:40.375767 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-2afc8d24-029a-408a-9be3-bbd8ec28d27b tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:40.382493 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2afc8d24-029a-408a-9be3-bbd8ec28d27b tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:40.382937 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2afc8d24-029a-408a-9be3-bbd8ec28d27b tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:40.383707 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2afc8d24-029a-408a-9be3-bbd8ec28d27b tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:40.384163 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2afc8d24-029a-408a-9be3-bbd8ec28d27b tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:40.501060 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-4756ecc8-27e6-412d-a725-f5bf5ea18a44 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:40.501690 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-4756ecc8-27e6-412d-a725-f5bf5ea18a44 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:40.514439 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2afc8d24-029a-408a-9be3-bbd8ec28d27b tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:40.514599 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4756ecc8-27e6-412d-a725-f5bf5ea18a44 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:40.514920 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4756ecc8-27e6-412d-a725-f5bf5ea18a44 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:40.515695 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4756ecc8-27e6-412d-a725-f5bf5ea18a44 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:40.516157 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4756ecc8-27e6-412d-a725-f5bf5ea18a44 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:40.521753 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-2afc8d24-029a-408a-9be3-bbd8ec28d27b tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1362 microversion: 2.1 time: 0.150362 Jun 24 10:01:40.522353 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 56/123] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:40 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:40.644931 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-4756ecc8-27e6-412d-a725-f5bf5ea18a44 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:40.653952 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-4756ecc8-27e6-412d-a725-f5bf5ea18a44 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1314 microversion: 2.1 time: 0.156694 Jun 24 10:01:40.654666 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 68/124] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:40 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:01:40.656684 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-3d0f8f87-0437-4727-b40d-4c4a788b724c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:40.657301 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-3d0f8f87-0437-4727-b40d-4c4a788b724c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:40.663728 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3d0f8f87-0437-4727-b40d-4c4a788b724c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:40.664199 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3d0f8f87-0437-4727-b40d-4c4a788b724c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:40.664965 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3d0f8f87-0437-4727-b40d-4c4a788b724c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:40.665396 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3d0f8f87-0437-4727-b40d-4c4a788b724c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:40.794426 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-3d0f8f87-0437-4727-b40d-4c4a788b724c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:40.802230 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-3d0f8f87-0437-4727-b40d-4c4a788b724c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:40.804388 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-3d0f8f87-0437-4727-b40d-4c4a788b724c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:40.805483 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-3d0f8f87-0437-4727-b40d-4c4a788b724c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1405 microversion: 2.20 time: 0.152663 Jun 24 10:01:40.806039 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 57/125] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:01:40 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:01:40.937097 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-f0a214ed-6ce4-4a44-b221-3525078aa509 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:40.937785 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-f0a214ed-6ce4-4a44-b221-3525078aa509 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:40.944934 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f0a214ed-6ce4-4a44-b221-3525078aa509 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:40.945440 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f0a214ed-6ce4-4a44-b221-3525078aa509 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:40.946339 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f0a214ed-6ce4-4a44-b221-3525078aa509 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:40.946773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f0a214ed-6ce4-4a44-b221-3525078aa509 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:41.085027 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-f0a214ed-6ce4-4a44-b221-3525078aa509 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:41.093186 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-f0a214ed-6ce4-4a44-b221-3525078aa509 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1321 microversion: 2.1 time: 0.159998 Jun 24 10:01:41.093803 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 69/126] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:40 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:41.538756 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-c3753161-a55c-45cd-b1a9-37381b94f5ab tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:41.539384 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-c3753161-a55c-45cd-b1a9-37381b94f5ab tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:41.546706 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c3753161-a55c-45cd-b1a9-37381b94f5ab tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:41.547518 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c3753161-a55c-45cd-b1a9-37381b94f5ab tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:41.548335 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c3753161-a55c-45cd-b1a9-37381b94f5ab tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:41.548771 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c3753161-a55c-45cd-b1a9-37381b94f5ab tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:41.671356 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-45c10274-ba92-4274-8bc6-58a75c01e391 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:41.672171 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-45c10274-ba92-4274-8bc6-58a75c01e391 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:41.678809 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-45c10274-ba92-4274-8bc6-58a75c01e391 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:41.679267 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-45c10274-ba92-4274-8bc6-58a75c01e391 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:41.680038 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-45c10274-ba92-4274-8bc6-58a75c01e391 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:41.680504 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-45c10274-ba92-4274-8bc6-58a75c01e391 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:41.698468 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=100 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:01:41.846861 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-45c10274-ba92-4274-8bc6-58a75c01e391 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:41.854857 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-45c10274-ba92-4274-8bc6-58a75c01e391 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1314 microversion: 2.1 time: 0.187645 Jun 24 10:01:41.855982 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 70/127] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:41 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:01:41.861022 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-49b9fc0a-841d-4898-a200-5ad549f99c6d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:41.861829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-49b9fc0a-841d-4898-a200-5ad549f99c6d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:41.869043 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-49b9fc0a-841d-4898-a200-5ad549f99c6d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:41.869491 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-49b9fc0a-841d-4898-a200-5ad549f99c6d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:41.870269 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-49b9fc0a-841d-4898-a200-5ad549f99c6d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:41.870700 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-49b9fc0a-841d-4898-a200-5ad549f99c6d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:41.959274 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-c3753161-a55c-45cd-b1a9-37381b94f5ab tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:41.968997 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-c3753161-a55c-45cd-b1a9-37381b94f5ab tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1362 microversion: 2.1 time: 0.434110 Jun 24 10:01:41.980229 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 58/128] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:41 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1362 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:42.010620 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-49b9fc0a-841d-4898-a200-5ad549f99c6d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:42.021249 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-49b9fc0a-841d-4898-a200-5ad549f99c6d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:42.023294 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-49b9fc0a-841d-4898-a200-5ad549f99c6d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:42.024422 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-49b9fc0a-841d-4898-a200-5ad549f99c6d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1405 microversion: 2.20 time: 0.167966 Jun 24 10:01:42.024992 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 71/129] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:01:41 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:01:42.110487 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-f360537e-fcf8-4394-82bd-8b7353a75a88 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:42.111140 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-f360537e-fcf8-4394-82bd-8b7353a75a88 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:42.117172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f360537e-fcf8-4394-82bd-8b7353a75a88 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:42.117627 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f360537e-fcf8-4394-82bd-8b7353a75a88 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:42.118394 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f360537e-fcf8-4394-82bd-8b7353a75a88 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:42.118834 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f360537e-fcf8-4394-82bd-8b7353a75a88 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:42.638074 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-f360537e-fcf8-4394-82bd-8b7353a75a88 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:42.650025 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-f360537e-fcf8-4394-82bd-8b7353a75a88 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1321 microversion: 2.1 time: 0.543277 Jun 24 10:01:42.654132 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 59/130] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:42 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1321 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:42.873162 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-1486a2ba-71fb-4eec-a2fc-38ebdc3d0740 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:42.873908 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-1486a2ba-71fb-4eec-a2fc-38ebdc3d0740 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:42.882826 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1486a2ba-71fb-4eec-a2fc-38ebdc3d0740 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:42.885663 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1486a2ba-71fb-4eec-a2fc-38ebdc3d0740 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:42.887266 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1486a2ba-71fb-4eec-a2fc-38ebdc3d0740 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:42.895420 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1486a2ba-71fb-4eec-a2fc-38ebdc3d0740 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:42.992649 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-3431e6a8-dfd1-4a13-bc12-1d07e69d85a9 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:42.993786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-3431e6a8-dfd1-4a13-bc12-1d07e69d85a9 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:43.031865 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3431e6a8-dfd1-4a13-bc12-1d07e69d85a9 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:43.032981 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3431e6a8-dfd1-4a13-bc12-1d07e69d85a9 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:43.034533 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3431e6a8-dfd1-4a13-bc12-1d07e69d85a9 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:43.035197 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3431e6a8-dfd1-4a13-bc12-1d07e69d85a9 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:43.256255 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-1486a2ba-71fb-4eec-a2fc-38ebdc3d0740 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:43.265079 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-1486a2ba-71fb-4eec-a2fc-38ebdc3d0740 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1314 microversion: 2.1 time: 0.396708 Jun 24 10:01:43.266200 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 72/131] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:42 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:43.271608 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-3e8e4904-eea8-4d95-abbf-25fee8c5f2ac req-7e5f56bb-e208-4d20-a828-3abc80891ada service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb", "tag": "17817cc3-73eb-4391-b5de-08503690fb3b"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:01:43.286102 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-3e8e4904-eea8-4d95-abbf-25fee8c5f2ac req-7e5f56bb-e208-4d20-a828-3abc80891ada service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:43.286928 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-3e8e4904-eea8-4d95-abbf-25fee8c5f2ac req-7e5f56bb-e208-4d20-a828-3abc80891ada service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:43.312282 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-3e8e4904-eea8-4d95-abbf-25fee8c5f2ac req-7e5f56bb-e208-4d20-a828-3abc80891ada service nova] Creating event network-changed:17817cc3-73eb-4391-b5de-08503690fb3b for instance e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb on hv-cinder-84327 Jun 24 10:01:43.328661 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-3e8e4904-eea8-4d95-abbf-25fee8c5f2ac req-7e5f56bb-e208-4d20-a828-3abc80891ada service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060869 Jun 24 10:01:43.332078 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 73/132] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:43.343867 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-d411885b-9b2e-437c-85a8-eacdf512935b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:43.345696 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-d411885b-9b2e-437c-85a8-eacdf512935b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:43.391380 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d411885b-9b2e-437c-85a8-eacdf512935b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:43.391827 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d411885b-9b2e-437c-85a8-eacdf512935b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:43.394965 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d411885b-9b2e-437c-85a8-eacdf512935b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:43.400679 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d411885b-9b2e-437c-85a8-eacdf512935b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:43.448176 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-3431e6a8-dfd1-4a13-bc12-1d07e69d85a9 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:43.457100 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-3431e6a8-dfd1-4a13-bc12-1d07e69d85a9 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1362 microversion: 2.1 time: 0.471252 Jun 24 10:01:43.458356 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 60/133] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:42 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1362 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:43.613233 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d411885b-9b2e-437c-85a8-eacdf512935b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:43.613233 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d411885b-9b2e-437c-85a8-eacdf512935b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:43.613934 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d411885b-9b2e-437c-85a8-eacdf512935b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:43.613934 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-d411885b-9b2e-437c-85a8-eacdf512935b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1405 microversion: 2.20 time: 0.229606 Jun 24 10:01:43.613934 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 74/134] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:01:43 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1405 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:01:43.669775 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-2b653f21-8b69-4ca0-9ccc-8f8c6994b4a3 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:43.670394 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-2b653f21-8b69-4ca0-9ccc-8f8c6994b4a3 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:43.676469 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2b653f21-8b69-4ca0-9ccc-8f8c6994b4a3 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:43.676925 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2b653f21-8b69-4ca0-9ccc-8f8c6994b4a3 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:43.677687 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2b653f21-8b69-4ca0-9ccc-8f8c6994b4a3 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:43.678790 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2b653f21-8b69-4ca0-9ccc-8f8c6994b4a3 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:43.825290 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2b653f21-8b69-4ca0-9ccc-8f8c6994b4a3 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:43.834170 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-2b653f21-8b69-4ca0-9ccc-8f8c6994b4a3 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1321 microversion: 2.1 time: 0.167315 Jun 24 10:01:43.834170 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 61/135] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:43 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:44.282377 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-0911fe26-f5ab-43cd-a699-b034ad3de736 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:44.283113 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-0911fe26-f5ab-43cd-a699-b034ad3de736 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:44.290290 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0911fe26-f5ab-43cd-a699-b034ad3de736 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:44.290731 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0911fe26-f5ab-43cd-a699-b034ad3de736 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:44.294418 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0911fe26-f5ab-43cd-a699-b034ad3de736 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:44.294418 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0911fe26-f5ab-43cd-a699-b034ad3de736 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:44.425960 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-0911fe26-f5ab-43cd-a699-b034ad3de736 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:44.433800 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-0911fe26-f5ab-43cd-a699-b034ad3de736 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1314 microversion: 2.1 time: 0.155258 Jun 24 10:01:44.434371 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 75/136] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:44 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:44.473714 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-e88ef94a-9e95-4dd4-9cea-7facd4a43fe2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:44.474405 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-e88ef94a-9e95-4dd4-9cea-7facd4a43fe2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:44.480806 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e88ef94a-9e95-4dd4-9cea-7facd4a43fe2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:44.481336 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e88ef94a-9e95-4dd4-9cea-7facd4a43fe2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:44.482341 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e88ef94a-9e95-4dd4-9cea-7facd4a43fe2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:44.482737 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e88ef94a-9e95-4dd4-9cea-7facd4a43fe2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:44.487197 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=100 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:01:44.618485 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-e88ef94a-9e95-4dd4-9cea-7facd4a43fe2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:44.626030 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-e88ef94a-9e95-4dd4-9cea-7facd4a43fe2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1362 microversion: 2.1 time: 0.156311 Jun 24 10:01:44.627176 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 62/137] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:44 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:44.633494 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-91a93910-879f-4d7c-9a8e-4bbdd73c80f3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:44.634105 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-91a93910-879f-4d7c-9a8e-4bbdd73c80f3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:44.640569 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-91a93910-879f-4d7c-9a8e-4bbdd73c80f3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:44.641041 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-91a93910-879f-4d7c-9a8e-4bbdd73c80f3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:44.641781 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-91a93910-879f-4d7c-9a8e-4bbdd73c80f3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:44.642194 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-91a93910-879f-4d7c-9a8e-4bbdd73c80f3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:44.770057 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-91a93910-879f-4d7c-9a8e-4bbdd73c80f3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:44.778592 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-91a93910-879f-4d7c-9a8e-4bbdd73c80f3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:44.780099 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-91a93910-879f-4d7c-9a8e-4bbdd73c80f3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:44.781229 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-91a93910-879f-4d7c-9a8e-4bbdd73c80f3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1405 microversion: 2.20 time: 0.152272 Jun 24 10:01:44.781798 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 76/138] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:01:44 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:01:44.849321 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-3026db5a-577a-49f1-9495-da79a1b6e8bf tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:44.849961 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-3026db5a-577a-49f1-9495-da79a1b6e8bf tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:44.855999 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3026db5a-577a-49f1-9495-da79a1b6e8bf tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:44.856485 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3026db5a-577a-49f1-9495-da79a1b6e8bf tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:44.857266 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3026db5a-577a-49f1-9495-da79a1b6e8bf tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:44.857705 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3026db5a-577a-49f1-9495-da79a1b6e8bf tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:44.985096 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-3026db5a-577a-49f1-9495-da79a1b6e8bf tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:44.992896 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-3026db5a-577a-49f1-9495-da79a1b6e8bf tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1321 microversion: 2.1 time: 0.147326 Jun 24 10:01:44.993454 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 63/139] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:44 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:45.347323 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-2418ec91-448f-4d07-b731-67d171c6a60b req-949a19c3-e3d3-4aed-b617-2eec419133f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84bc600e-1c87-4ba3-9dfa-421ee774e45e", "tag": "9e3214ad-2d0a-4c9c-aa84-e405ba29e4b8"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:01:45.356769 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-2418ec91-448f-4d07-b731-67d171c6a60b req-949a19c3-e3d3-4aed-b617-2eec419133f4 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:45.357302 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-2418ec91-448f-4d07-b731-67d171c6a60b req-949a19c3-e3d3-4aed-b617-2eec419133f4 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:45.368959 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-2418ec91-448f-4d07-b731-67d171c6a60b req-949a19c3-e3d3-4aed-b617-2eec419133f4 service nova] Creating event network-changed:9e3214ad-2d0a-4c9c-aa84-e405ba29e4b8 for instance 84bc600e-1c87-4ba3-9dfa-421ee774e45e on hv-cinder-84327 Jun 24 10:01:45.373595 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-2418ec91-448f-4d07-b731-67d171c6a60b req-949a19c3-e3d3-4aed-b617-2eec419133f4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029913 Jun 24 10:01:45.374162 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 77/140] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:45.450678 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-6d406763-6627-4c56-a1b7-c8917f6344ae tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:45.451316 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-6d406763-6627-4c56-a1b7-c8917f6344ae tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:45.457489 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6d406763-6627-4c56-a1b7-c8917f6344ae tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:45.457932 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6d406763-6627-4c56-a1b7-c8917f6344ae tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:45.458675 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6d406763-6627-4c56-a1b7-c8917f6344ae tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:45.459135 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6d406763-6627-4c56-a1b7-c8917f6344ae tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:45.590507 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-6d406763-6627-4c56-a1b7-c8917f6344ae tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:45.598003 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-6d406763-6627-4c56-a1b7-c8917f6344ae tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1314 microversion: 2.1 time: 0.151152 Jun 24 10:01:45.598575 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 64/141] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:45 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:45.643370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-ee8bd6cd-6a6a-4808-a73c-8db6ee7ecd72 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:45.644114 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-ee8bd6cd-6a6a-4808-a73c-8db6ee7ecd72 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:45.651632 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ee8bd6cd-6a6a-4808-a73c-8db6ee7ecd72 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:45.652321 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ee8bd6cd-6a6a-4808-a73c-8db6ee7ecd72 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:45.653239 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ee8bd6cd-6a6a-4808-a73c-8db6ee7ecd72 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:45.653677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ee8bd6cd-6a6a-4808-a73c-8db6ee7ecd72 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:45.783778 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-ee8bd6cd-6a6a-4808-a73c-8db6ee7ecd72 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:45.791771 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-ee8bd6cd-6a6a-4808-a73c-8db6ee7ecd72 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1362 microversion: 2.1 time: 0.152695 Jun 24 10:01:45.792623 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 78/142] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:45 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:45.798585 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-33ccb897-ea9b-4f4e-be7b-63ed6850ff91 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:45.801912 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-33ccb897-ea9b-4f4e-be7b-63ed6850ff91 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:45.805611 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-33ccb897-ea9b-4f4e-be7b-63ed6850ff91 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:45.806064 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-33ccb897-ea9b-4f4e-be7b-63ed6850ff91 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:45.806830 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-33ccb897-ea9b-4f4e-be7b-63ed6850ff91 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:45.807271 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-33ccb897-ea9b-4f4e-be7b-63ed6850ff91 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:45.934817 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-33ccb897-ea9b-4f4e-be7b-63ed6850ff91 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:45.942731 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-33ccb897-ea9b-4f4e-be7b-63ed6850ff91 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:45.944275 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-33ccb897-ea9b-4f4e-be7b-63ed6850ff91 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:45.945896 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-33ccb897-ea9b-4f4e-be7b-63ed6850ff91 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1405 microversion: 2.20 time: 0.151205 Jun 24 10:01:45.946459 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 65/143] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:01:45 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:01:46.009839 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-f6fab9d3-4de4-462d-a90b-825854b96d60 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:46.010542 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-f6fab9d3-4de4-462d-a90b-825854b96d60 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:46.016591 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f6fab9d3-4de4-462d-a90b-825854b96d60 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:46.017036 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f6fab9d3-4de4-462d-a90b-825854b96d60 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:46.017789 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f6fab9d3-4de4-462d-a90b-825854b96d60 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:46.018244 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f6fab9d3-4de4-462d-a90b-825854b96d60 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:46.222845 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-f6fab9d3-4de4-462d-a90b-825854b96d60 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:46.230468 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-f6fab9d3-4de4-462d-a90b-825854b96d60 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1321 microversion: 2.1 time: 0.224893 Jun 24 10:01:46.231059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 79/144] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:46 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:46.614852 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-51b09f09-1303-4aad-9aa4-4df388d0bf9d tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:46.615582 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-51b09f09-1303-4aad-9aa4-4df388d0bf9d tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:46.622317 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-51b09f09-1303-4aad-9aa4-4df388d0bf9d tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:46.622725 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-51b09f09-1303-4aad-9aa4-4df388d0bf9d tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:46.623552 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-51b09f09-1303-4aad-9aa4-4df388d0bf9d tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:46.623979 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-51b09f09-1303-4aad-9aa4-4df388d0bf9d tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:46.761994 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-51b09f09-1303-4aad-9aa4-4df388d0bf9d tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:46.769531 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-51b09f09-1303-4aad-9aa4-4df388d0bf9d tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1314 microversion: 2.1 time: 0.158622 Jun 24 10:01:46.770096 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 66/145] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:46 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:46.808549 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-df282ab5-a173-427e-9042-01b46864864c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:46.809252 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-df282ab5-a173-427e-9042-01b46864864c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:46.815223 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-df282ab5-a173-427e-9042-01b46864864c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:46.815664 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-df282ab5-a173-427e-9042-01b46864864c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:46.816442 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-df282ab5-a173-427e-9042-01b46864864c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:46.816870 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-df282ab5-a173-427e-9042-01b46864864c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:46.965190 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-6489f9f9-4ff4-4ba7-86ed-a00037470077 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:46.965934 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-6489f9f9-4ff4-4ba7-86ed-a00037470077 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:46.972656 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6489f9f9-4ff4-4ba7-86ed-a00037470077 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:46.973595 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6489f9f9-4ff4-4ba7-86ed-a00037470077 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:46.974624 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6489f9f9-4ff4-4ba7-86ed-a00037470077 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:46.975299 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6489f9f9-4ff4-4ba7-86ed-a00037470077 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:47.012521 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-df282ab5-a173-427e-9042-01b46864864c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:47.023762 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-df282ab5-a173-427e-9042-01b46864864c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1362 microversion: 2.1 time: 0.217991 Jun 24 10:01:47.024203 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 80/146] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:46 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:47.247724 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-7b7248ea-e7e1-4a4b-aa06-c9891c593e86 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:47.248384 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-7b7248ea-e7e1-4a4b-aa06-c9891c593e86 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:47.255345 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7b7248ea-e7e1-4a4b-aa06-c9891c593e86 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:47.255664 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7b7248ea-e7e1-4a4b-aa06-c9891c593e86 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:47.256458 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7b7248ea-e7e1-4a4b-aa06-c9891c593e86 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:47.257514 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7b7248ea-e7e1-4a4b-aa06-c9891c593e86 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:47.257905 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-6489f9f9-4ff4-4ba7-86ed-a00037470077 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:47.266347 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-6489f9f9-4ff4-4ba7-86ed-a00037470077 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:47.268096 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-6489f9f9-4ff4-4ba7-86ed-a00037470077 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:47.269346 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-6489f9f9-4ff4-4ba7-86ed-a00037470077 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1405 microversion: 2.20 time: 0.309400 Jun 24 10:01:47.270121 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 67/147] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:01:46 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1405 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:01:47.407463 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-7b7248ea-e7e1-4a4b-aa06-c9891c593e86 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:47.416217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-7b7248ea-e7e1-4a4b-aa06-c9891c593e86 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1321 microversion: 2.1 time: 0.172561 Jun 24 10:01:47.423794 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 81/148] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:47 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:47.786946 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-026535a4-cbcb-4f62-ac98-0aaa6262a791 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:47.788045 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-026535a4-cbcb-4f62-ac98-0aaa6262a791 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:47.796864 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-026535a4-cbcb-4f62-ac98-0aaa6262a791 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:47.798909 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-026535a4-cbcb-4f62-ac98-0aaa6262a791 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:47.800088 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-026535a4-cbcb-4f62-ac98-0aaa6262a791 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:47.800722 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-026535a4-cbcb-4f62-ac98-0aaa6262a791 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:48.039713 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-0bd0849c-11df-4eb0-b91f-0ed7c9b0eacc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:48.040292 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-0bd0849c-11df-4eb0-b91f-0ed7c9b0eacc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:48.050989 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0bd0849c-11df-4eb0-b91f-0ed7c9b0eacc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:48.051551 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0bd0849c-11df-4eb0-b91f-0ed7c9b0eacc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:48.056671 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0bd0849c-11df-4eb0-b91f-0ed7c9b0eacc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:48.057351 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0bd0849c-11df-4eb0-b91f-0ed7c9b0eacc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:48.283339 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-0bd0849c-11df-4eb0-b91f-0ed7c9b0eacc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:48.291724 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-0bd0849c-11df-4eb0-b91f-0ed7c9b0eacc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1362 microversion: 2.1 time: 0.255786 Jun 24 10:01:48.293446 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 82/149] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:48 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1362 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:01:48.298472 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-d0be8c86-63a3-4a02-8d6b-ab9fd66c3523 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:48.299080 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-d0be8c86-63a3-4a02-8d6b-ab9fd66c3523 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:48.307965 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d0be8c86-63a3-4a02-8d6b-ab9fd66c3523 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:48.308452 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d0be8c86-63a3-4a02-8d6b-ab9fd66c3523 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:48.309221 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d0be8c86-63a3-4a02-8d6b-ab9fd66c3523 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:48.310157 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d0be8c86-63a3-4a02-8d6b-ab9fd66c3523 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:48.328762 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-026535a4-cbcb-4f62-ac98-0aaa6262a791 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:48.341548 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-026535a4-cbcb-4f62-ac98-0aaa6262a791 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1314 microversion: 2.1 time: 0.558206 Jun 24 10:01:48.345837 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 68/150] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:47 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1314 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:48.435184 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-1ec8d1c2-d7de-48ce-b7a1-89526d1a85f8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:48.435308 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-1ec8d1c2-d7de-48ce-b7a1-89526d1a85f8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:48.443906 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1ec8d1c2-d7de-48ce-b7a1-89526d1a85f8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:48.445894 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1ec8d1c2-d7de-48ce-b7a1-89526d1a85f8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:48.446628 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1ec8d1c2-d7de-48ce-b7a1-89526d1a85f8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:48.447146 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1ec8d1c2-d7de-48ce-b7a1-89526d1a85f8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:48.485274 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d0be8c86-63a3-4a02-8d6b-ab9fd66c3523 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:48.495739 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d0be8c86-63a3-4a02-8d6b-ab9fd66c3523 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:48.498194 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d0be8c86-63a3-4a02-8d6b-ab9fd66c3523 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:48.499496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-d0be8c86-63a3-4a02-8d6b-ab9fd66c3523 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1405 microversion: 2.20 time: 0.204898 Jun 24 10:01:48.505923 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 83/151] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:01:48 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1405 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:01:48.677984 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-1ec8d1c2-d7de-48ce-b7a1-89526d1a85f8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:48.686507 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-1ec8d1c2-d7de-48ce-b7a1-89526d1a85f8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1321 microversion: 2.1 time: 0.256251 Jun 24 10:01:48.687127 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 69/152] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:48 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:48.728076 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-1e92449d-7ff6-4dd3-a4b6-fd0b216d72ef req-4bf4c48b-6b22-40fd-8dd9-2595066ba87e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffd6d45e-4648-4b13-acb5-3473bf9e935a", "name": "network-vif-plugged", "status": "completed", "tag": "ac909eb0-aeea-4b66-970c-1e6b004e8902"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:01:48.735969 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-1e92449d-7ff6-4dd3-a4b6-fd0b216d72ef req-4bf4c48b-6b22-40fd-8dd9-2595066ba87e service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:48.740976 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-1e92449d-7ff6-4dd3-a4b6-fd0b216d72ef req-4bf4c48b-6b22-40fd-8dd9-2595066ba87e service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:48.747414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-1e92449d-7ff6-4dd3-a4b6-fd0b216d72ef req-4bf4c48b-6b22-40fd-8dd9-2595066ba87e service nova] Creating event network-vif-plugged:ac909eb0-aeea-4b66-970c-1e6b004e8902 for instance ffd6d45e-4648-4b13-acb5-3473bf9e935a on hv-cinder-84327 Jun 24 10:01:48.752171 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-1e92449d-7ff6-4dd3-a4b6-fd0b216d72ef req-4bf4c48b-6b22-40fd-8dd9-2595066ba87e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089978 Jun 24 10:01:48.752745 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 84/153] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:01:49.309474 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-16ef9a69-d9fd-458a-af09-fbf31aa69826 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:49.310087 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-16ef9a69-d9fd-458a-af09-fbf31aa69826 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:49.316338 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-16ef9a69-d9fd-458a-af09-fbf31aa69826 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:49.316975 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-16ef9a69-d9fd-458a-af09-fbf31aa69826 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:49.317746 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-16ef9a69-d9fd-458a-af09-fbf31aa69826 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:49.319140 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-16ef9a69-d9fd-458a-af09-fbf31aa69826 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:49.360975 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-9c2df204-0248-4544-af67-6e68c06059bb tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:49.361762 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-9c2df204-0248-4544-af67-6e68c06059bb tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:49.368648 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9c2df204-0248-4544-af67-6e68c06059bb tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:49.369091 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9c2df204-0248-4544-af67-6e68c06059bb tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:49.369849 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9c2df204-0248-4544-af67-6e68c06059bb tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:49.370283 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9c2df204-0248-4544-af67-6e68c06059bb tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:49.468339 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-16ef9a69-d9fd-458a-af09-fbf31aa69826 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:49.482412 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-16ef9a69-d9fd-458a-af09-fbf31aa69826 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1362 microversion: 2.1 time: 0.176562 Jun 24 10:01:49.486247 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 70/154] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:49 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:49.518726 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-752d130e-7d71-450d-a4f8-d3f7cf14749a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:49.519398 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-752d130e-7d71-450d-a4f8-d3f7cf14749a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:49.525926 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-752d130e-7d71-450d-a4f8-d3f7cf14749a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:49.526380 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-752d130e-7d71-450d-a4f8-d3f7cf14749a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:49.527199 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-752d130e-7d71-450d-a4f8-d3f7cf14749a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:49.527643 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-752d130e-7d71-450d-a4f8-d3f7cf14749a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:49.551896 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-9c2df204-0248-4544-af67-6e68c06059bb tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:49.560736 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-9c2df204-0248-4544-af67-6e68c06059bb tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1314 microversion: 2.1 time: 0.203930 Jun 24 10:01:49.561450 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 85/155] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:49 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:01:49.666538 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-752d130e-7d71-450d-a4f8-d3f7cf14749a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:49.675086 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-752d130e-7d71-450d-a4f8-d3f7cf14749a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:49.676641 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-752d130e-7d71-450d-a4f8-d3f7cf14749a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:49.677856 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-752d130e-7d71-450d-a4f8-d3f7cf14749a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1405 microversion: 2.20 time: 0.163289 Jun 24 10:01:49.678405 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 71/156] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:01:49 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:01:49.703688 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-d16d2ca3-fab5-4a56-bec8-f17636a2bacd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:49.704484 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-d16d2ca3-fab5-4a56-bec8-f17636a2bacd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:49.710598 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d16d2ca3-fab5-4a56-bec8-f17636a2bacd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:49.711095 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d16d2ca3-fab5-4a56-bec8-f17636a2bacd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:49.711877 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d16d2ca3-fab5-4a56-bec8-f17636a2bacd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:49.712325 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d16d2ca3-fab5-4a56-bec8-f17636a2bacd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:49.851683 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d16d2ca3-fab5-4a56-bec8-f17636a2bacd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:49.859713 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-d16d2ca3-fab5-4a56-bec8-f17636a2bacd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1321 microversion: 2.1 time: 0.159868 Jun 24 10:01:49.869355 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 86/157] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:49 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:50.501753 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-e378fe84-eb5d-4ca9-85d2-7275673c06a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:50.502366 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-e378fe84-eb5d-4ca9-85d2-7275673c06a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:50.555595 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e378fe84-eb5d-4ca9-85d2-7275673c06a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:50.559704 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e378fe84-eb5d-4ca9-85d2-7275673c06a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:50.561187 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e378fe84-eb5d-4ca9-85d2-7275673c06a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:50.563444 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e378fe84-eb5d-4ca9-85d2-7275673c06a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:50.581074 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-297e7275-1566-433a-910c-7c6588d88fa2 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:50.581754 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-297e7275-1566-433a-910c-7c6588d88fa2 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:50.595352 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-297e7275-1566-433a-910c-7c6588d88fa2 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:50.595807 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-297e7275-1566-433a-910c-7c6588d88fa2 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:50.596655 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-297e7275-1566-433a-910c-7c6588d88fa2 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:50.597079 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-297e7275-1566-433a-910c-7c6588d88fa2 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:50.893671 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-297e7275-1566-433a-910c-7c6588d88fa2 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:50.903333 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-297e7275-1566-433a-910c-7c6588d88fa2 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1314 microversion: 2.1 time: 0.328060 Jun 24 10:01:50.905089 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 87/158] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:50 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:01:50.911040 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-208c2853-19fa-47b1-b151-ac05480f01e3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:50.926061 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-208c2853-19fa-47b1-b151-ac05480f01e3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:50.932737 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-208c2853-19fa-47b1-b151-ac05480f01e3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:50.933191 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-208c2853-19fa-47b1-b151-ac05480f01e3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:50.933975 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-208c2853-19fa-47b1-b151-ac05480f01e3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:50.934416 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-208c2853-19fa-47b1-b151-ac05480f01e3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:50.999974 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-e378fe84-eb5d-4ca9-85d2-7275673c06a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:51.007621 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-e378fe84-eb5d-4ca9-85d2-7275673c06a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1362 microversion: 2.1 time: 0.510457 Jun 24 10:01:51.010377 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 72/159] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:50 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1362 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:51.017387 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-14da77ef-f2c3-4bc3-a90f-d86ef84dc603 req-e7caeb3a-6bea-4ff8-8152-0ce285e319ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6", "name": "network-vif-plugged", "status": "completed", "tag": "be1d3537-038c-4ba5-84f5-566839e929b4"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:01:51.028772 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-14da77ef-f2c3-4bc3-a90f-d86ef84dc603 req-e7caeb3a-6bea-4ff8-8152-0ce285e319ee service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:51.029510 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-14da77ef-f2c3-4bc3-a90f-d86ef84dc603 req-e7caeb3a-6bea-4ff8-8152-0ce285e319ee service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:51.050237 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-14da77ef-f2c3-4bc3-a90f-d86ef84dc603 req-e7caeb3a-6bea-4ff8-8152-0ce285e319ee service nova] Creating event network-vif-plugged:be1d3537-038c-4ba5-84f5-566839e929b4 for instance ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 on hv-cinder-84327 Jun 24 10:01:51.051553 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-14da77ef-f2c3-4bc3-a90f-d86ef84dc603 req-e7caeb3a-6bea-4ff8-8152-0ce285e319ee service nova] Acquired lock "compute-rpcapi-router" {{(pid=124980) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 24 10:01:51.053067 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5d4f1aa9-79c0-4463-be4c-9c32ef71bf68 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:51.053864 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5d4f1aa9-79c0-4463-be4c-9c32ef71bf68 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:51.055487 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5d4f1aa9-79c0-4463-be4c-9c32ef71bf68 None None] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:51.056081 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5d4f1aa9-79c0-4463-be4c-9c32ef71bf68 None None] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:51.071674 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.compute.rpcapi [None req-5d4f1aa9-79c0-4463-be4c-9c32ef71bf68 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 24 10:01:51.072599 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5d4f1aa9-79c0-4463-be4c-9c32ef71bf68 None None] Releasing lock "compute-rpcapi-router" {{(pid=124980) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 24 10:01:51.091789 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-208c2853-19fa-47b1-b151-ac05480f01e3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:51.095849 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=100 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:01:51.101168 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-208c2853-19fa-47b1-b151-ac05480f01e3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:51.103330 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-5d4f1aa9-79c0-4463-be4c-9c32ef71bf68 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091508 Jun 24 10:01:51.103448 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-208c2853-19fa-47b1-b151-ac05480f01e3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:51.103989 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 73/160] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:51.104691 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-208c2853-19fa-47b1-b151-ac05480f01e3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1405 microversion: 2.20 time: 0.198207 Jun 24 10:01:51.111101 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 88/161] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:01:50 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1405 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:01:51.112211 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-03db92df-66ff-4511-8bcb-6f1775460049 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:51.112919 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-03db92df-66ff-4511-8bcb-6f1775460049 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:51.126415 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-03db92df-66ff-4511-8bcb-6f1775460049 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:51.126913 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-03db92df-66ff-4511-8bcb-6f1775460049 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:51.127891 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-03db92df-66ff-4511-8bcb-6f1775460049 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:51.128370 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-03db92df-66ff-4511-8bcb-6f1775460049 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:51.384384 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-03db92df-66ff-4511-8bcb-6f1775460049 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:51.392693 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-03db92df-66ff-4511-8bcb-6f1775460049 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1321 microversion: 2.1 time: 0.284597 Jun 24 10:01:51.393737 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 74/162] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:51 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1321 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:51.922414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-30293807-bacc-4484-b3e8-cfd09ef2728e tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:51.923002 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-30293807-bacc-4484-b3e8-cfd09ef2728e tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:51.929908 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-30293807-bacc-4484-b3e8-cfd09ef2728e tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:51.931021 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-30293807-bacc-4484-b3e8-cfd09ef2728e tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:51.931119 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-30293807-bacc-4484-b3e8-cfd09ef2728e tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:51.931591 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-30293807-bacc-4484-b3e8-cfd09ef2728e tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:52.025004 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-4725cd6a-2af3-4a32-b84a-79e0638ccb01 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:52.025624 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-4725cd6a-2af3-4a32-b84a-79e0638ccb01 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:52.033092 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4725cd6a-2af3-4a32-b84a-79e0638ccb01 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:52.033910 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4725cd6a-2af3-4a32-b84a-79e0638ccb01 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:52.034803 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4725cd6a-2af3-4a32-b84a-79e0638ccb01 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:52.035426 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4725cd6a-2af3-4a32-b84a-79e0638ccb01 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:52.087246 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-30293807-bacc-4484-b3e8-cfd09ef2728e tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:52.097268 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-30293807-bacc-4484-b3e8-cfd09ef2728e tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1314 microversion: 2.1 time: 0.178978 Jun 24 10:01:52.098199 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 89/163] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:51 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:52.122993 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-ddfbde0d-6e71-4670-9dbe-4c3c9ab747cf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:52.124490 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-ddfbde0d-6e71-4670-9dbe-4c3c9ab747cf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:52.139479 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ddfbde0d-6e71-4670-9dbe-4c3c9ab747cf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:52.141668 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ddfbde0d-6e71-4670-9dbe-4c3c9ab747cf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:52.143340 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ddfbde0d-6e71-4670-9dbe-4c3c9ab747cf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:52.143987 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ddfbde0d-6e71-4670-9dbe-4c3c9ab747cf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:52.260706 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-4725cd6a-2af3-4a32-b84a-79e0638ccb01 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:52.269063 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-4725cd6a-2af3-4a32-b84a-79e0638ccb01 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1362 microversion: 2.1 time: 0.248645 Jun 24 10:01:52.270580 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 75/164] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:52 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:01:52.311564 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-ddfbde0d-6e71-4670-9dbe-4c3c9ab747cf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:52.321921 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-ddfbde0d-6e71-4670-9dbe-4c3c9ab747cf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:52.323372 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-ddfbde0d-6e71-4670-9dbe-4c3c9ab747cf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:52.324689 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-ddfbde0d-6e71-4670-9dbe-4c3c9ab747cf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1405 microversion: 2.20 time: 0.206055 Jun 24 10:01:52.325412 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 90/165] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:01:52 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1405 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:01:52.413735 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-2b84aabb-7fd3-426f-b823-0984b6a84a25 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:52.415528 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-2b84aabb-7fd3-426f-b823-0984b6a84a25 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:52.427281 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2b84aabb-7fd3-426f-b823-0984b6a84a25 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:52.429140 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2b84aabb-7fd3-426f-b823-0984b6a84a25 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:52.430647 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2b84aabb-7fd3-426f-b823-0984b6a84a25 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:52.432015 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2b84aabb-7fd3-426f-b823-0984b6a84a25 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:52.596027 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2b84aabb-7fd3-426f-b823-0984b6a84a25 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:52.605836 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-2b84aabb-7fd3-426f-b823-0984b6a84a25 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1321 microversion: 2.1 time: 0.198542 Jun 24 10:01:52.606666 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 76/166] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:52 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:53.114908 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-e4334c69-9181-4b8a-8b10-5f7d806f5699 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:53.116981 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-e4334c69-9181-4b8a-8b10-5f7d806f5699 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:53.120783 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-2059ee64-3885-42de-88c5-500b4200f56f req-7fbd4fdf-ff26-452a-bb92-a910f5c5d32a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84bc600e-1c87-4ba3-9dfa-421ee774e45e", "name": "network-vif-plugged", "status": "completed", "tag": "9e3214ad-2d0a-4c9c-aa84-e405ba29e4b8"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:01:53.125429 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e4334c69-9181-4b8a-8b10-5f7d806f5699 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:53.126109 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e4334c69-9181-4b8a-8b10-5f7d806f5699 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:53.127279 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e4334c69-9181-4b8a-8b10-5f7d806f5699 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:53.127780 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e4334c69-9181-4b8a-8b10-5f7d806f5699 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:53.130640 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-2059ee64-3885-42de-88c5-500b4200f56f req-7fbd4fdf-ff26-452a-bb92-a910f5c5d32a service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:53.131415 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-2059ee64-3885-42de-88c5-500b4200f56f req-7fbd4fdf-ff26-452a-bb92-a910f5c5d32a service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:53.145532 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-2059ee64-3885-42de-88c5-500b4200f56f req-7fbd4fdf-ff26-452a-bb92-a910f5c5d32a service nova] Creating event network-vif-plugged:9e3214ad-2d0a-4c9c-aa84-e405ba29e4b8 for instance 84bc600e-1c87-4ba3-9dfa-421ee774e45e on hv-cinder-84327 Jun 24 10:01:53.153114 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-2059ee64-3885-42de-88c5-500b4200f56f req-7fbd4fdf-ff26-452a-bb92-a910f5c5d32a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036673 Jun 24 10:01:53.154508 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 77/167] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:01:53.289699 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-81c01f57-b3c4-4774-83d1-8c114b839bc5 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:53.290816 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-81c01f57-b3c4-4774-83d1-8c114b839bc5 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:53.307305 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-81c01f57-b3c4-4774-83d1-8c114b839bc5 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:53.307762 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-81c01f57-b3c4-4774-83d1-8c114b839bc5 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:53.309460 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-81c01f57-b3c4-4774-83d1-8c114b839bc5 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:53.309902 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-81c01f57-b3c4-4774-83d1-8c114b839bc5 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:53.411377 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-e4334c69-9181-4b8a-8b10-5f7d806f5699 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:53.420322 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-e4334c69-9181-4b8a-8b10-5f7d806f5699 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1502 microversion: 2.1 time: 0.309449 Jun 24 10:01:53.420989 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 91/168] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:53 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1502 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:53.426396 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-65de9e06-96b6-48d3-aa70-cc97a87b7eff tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:53.427208 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-65de9e06-96b6-48d3-aa70-cc97a87b7eff tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:53.433662 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-65de9e06-96b6-48d3-aa70-cc97a87b7eff tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:53.434769 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-65de9e06-96b6-48d3-aa70-cc97a87b7eff tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:53.435193 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-65de9e06-96b6-48d3-aa70-cc97a87b7eff tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:53.435777 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-65de9e06-96b6-48d3-aa70-cc97a87b7eff tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:53.543436 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-81c01f57-b3c4-4774-83d1-8c114b839bc5 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:53.551875 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-81c01f57-b3c4-4774-83d1-8c114b839bc5 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1362 microversion: 2.1 time: 0.268409 Jun 24 10:01:53.563029 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 78/169] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:53 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:01:53.630847 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-273b4f1b-96f1-4da7-b069-70410fc25241 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:53.632555 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-273b4f1b-96f1-4da7-b069-70410fc25241 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:53.639489 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-273b4f1b-96f1-4da7-b069-70410fc25241 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:53.639649 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-65de9e06-96b6-48d3-aa70-cc97a87b7eff tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:53.640414 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-273b4f1b-96f1-4da7-b069-70410fc25241 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:53.641544 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-273b4f1b-96f1-4da7-b069-70410fc25241 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:53.642252 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-273b4f1b-96f1-4da7-b069-70410fc25241 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:53.656526 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-65de9e06-96b6-48d3-aa70-cc97a87b7eff tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:53.659285 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-65de9e06-96b6-48d3-aa70-cc97a87b7eff tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:53.660690 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-65de9e06-96b6-48d3-aa70-cc97a87b7eff tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1405 microversion: 2.20 time: 0.238722 Jun 24 10:01:53.662812 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 92/170] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:01:53 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1405 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:01:53.819918 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-273b4f1b-96f1-4da7-b069-70410fc25241 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:53.825110 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=100 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:01:53.831321 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-273b4f1b-96f1-4da7-b069-70410fc25241 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1321 microversion: 2.1 time: 0.212312 Jun 24 10:01:53.843794 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 79/171] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:53 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:01:54.574804 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-83e27cf3-21ad-4d66-bee7-e69b922cfb69 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:54.576078 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-83e27cf3-21ad-4d66-bee7-e69b922cfb69 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:54.583437 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-83e27cf3-21ad-4d66-bee7-e69b922cfb69 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:54.584222 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-83e27cf3-21ad-4d66-bee7-e69b922cfb69 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:54.585695 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-83e27cf3-21ad-4d66-bee7-e69b922cfb69 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:54.586389 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-83e27cf3-21ad-4d66-bee7-e69b922cfb69 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:54.682044 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-ae1ef543-3f4b-45ad-a8c5-bf7e99a15a52 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:54.683333 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-ae1ef543-3f4b-45ad-a8c5-bf7e99a15a52 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:54.690620 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ae1ef543-3f4b-45ad-a8c5-bf7e99a15a52 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:54.696249 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ae1ef543-3f4b-45ad-a8c5-bf7e99a15a52 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:54.697335 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ae1ef543-3f4b-45ad-a8c5-bf7e99a15a52 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:54.697775 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ae1ef543-3f4b-45ad-a8c5-bf7e99a15a52 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:54.908900 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-ae1ef543-3f4b-45ad-a8c5-bf7e99a15a52 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:54.922999 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-ae1ef543-3f4b-45ad-a8c5-bf7e99a15a52 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:54.925335 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-ae1ef543-3f4b-45ad-a8c5-bf7e99a15a52 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:54.926671 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-ae1ef543-3f4b-45ad-a8c5-bf7e99a15a52 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1405 microversion: 2.20 time: 0.249274 Jun 24 10:01:54.927918 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 80/172] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:01:54 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1405 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:01:54.933672 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-088f2544-56b1-40df-9136-3982e0626b30 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:54.934579 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-088f2544-56b1-40df-9136-3982e0626b30 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:54.941952 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-088f2544-56b1-40df-9136-3982e0626b30 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:54.942750 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-088f2544-56b1-40df-9136-3982e0626b30 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:54.944370 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-088f2544-56b1-40df-9136-3982e0626b30 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:54.945020 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-088f2544-56b1-40df-9136-3982e0626b30 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:54.982681 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-83e27cf3-21ad-4d66-bee7-e69b922cfb69 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:55.000813 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-83e27cf3-21ad-4d66-bee7-e69b922cfb69 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1362 microversion: 2.1 time: 0.432899 Jun 24 10:01:55.001455 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 93/173] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:54 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1362 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:55.236620 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-6d7a9bca-b9b3-45bc-8f7f-045a186bb451 req-2bfef513-288d-4b1d-8863-f07bdbf16176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "904eb348-521e-499e-8127-cb3096230877", "name": "network-vif-plugged", "status": "completed", "tag": "bc68c0d7-3cc3-4add-8d35-8b1892ac129e"}, {"server_uuid": "e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb", "name": "network-vif-plugged", "status": "completed", "tag": "17817cc3-73eb-4391-b5de-08503690fb3b"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:01:55.247838 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-6d7a9bca-b9b3-45bc-8f7f-045a186bb451 req-2bfef513-288d-4b1d-8863-f07bdbf16176 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:55.248842 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-6d7a9bca-b9b3-45bc-8f7f-045a186bb451 req-2bfef513-288d-4b1d-8863-f07bdbf16176 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:55.266124 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-6d7a9bca-b9b3-45bc-8f7f-045a186bb451 req-2bfef513-288d-4b1d-8863-f07bdbf16176 service nova] Creating event network-vif-plugged:bc68c0d7-3cc3-4add-8d35-8b1892ac129e for instance 904eb348-521e-499e-8127-cb3096230877 on hv-cinder-84327 Jun 24 10:01:55.266700 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-6d7a9bca-b9b3-45bc-8f7f-045a186bb451 req-2bfef513-288d-4b1d-8863-f07bdbf16176 service nova] Creating event network-vif-plugged:17817cc3-73eb-4391-b5de-08503690fb3b for instance e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb on hv-cinder-84327 Jun 24 10:01:55.274658 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-6d7a9bca-b9b3-45bc-8f7f-045a186bb451 req-2bfef513-288d-4b1d-8863-f07bdbf16176 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042950 Jun 24 10:01:55.275236 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 94/174] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:01:55.318000 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-088f2544-56b1-40df-9136-3982e0626b30 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:55.330306 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-088f2544-56b1-40df-9136-3982e0626b30 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1321 microversion: 2.1 time: 0.400609 Jun 24 10:01:55.331679 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 81/175] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:54 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1321 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:55.404282 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-7d4ebd39-3033-4ea9-b5fa-207bde165e37 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23476e17-56b4-4bed-872e-11208c255fdc"}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:01:55.407172 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-7d4ebd39-3033-4ea9-b5fa-207bde165e37 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:55.413054 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7d4ebd39-3033-4ea9-b5fa-207bde165e37 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:55.413738 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7d4ebd39-3033-4ea9-b5fa-207bde165e37 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:55.414985 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7d4ebd39-3033-4ea9-b5fa-207bde165e37 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:55.415634 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7d4ebd39-3033-4ea9-b5fa-207bde165e37 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:55.946431 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-0caffcfd-b2e2-49eb-a883-2a32a7c0e5c7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:55.947051 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-0caffcfd-b2e2-49eb-a883-2a32a7c0e5c7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:55.953117 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0caffcfd-b2e2-49eb-a883-2a32a7c0e5c7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:55.953571 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0caffcfd-b2e2-49eb-a883-2a32a7c0e5c7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:55.954381 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0caffcfd-b2e2-49eb-a883-2a32a7c0e5c7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:55.954814 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0caffcfd-b2e2-49eb-a883-2a32a7c0e5c7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:56.235284 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-0caffcfd-b2e2-49eb-a883-2a32a7c0e5c7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:56.247819 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-0caffcfd-b2e2-49eb-a883-2a32a7c0e5c7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:56.252628 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-0caffcfd-b2e2-49eb-a883-2a32a7c0e5c7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:56.253636 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-0caffcfd-b2e2-49eb-a883-2a32a7c0e5c7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1405 microversion: 2.20 time: 0.311497 Jun 24 10:01:56.254209 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 82/176] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:01:55 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1405 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:01:56.259672 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-d3987d3d-836d-4778-997b-390c355e73aa tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:56.260713 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-d3987d3d-836d-4778-997b-390c355e73aa tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:56.272024 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d3987d3d-836d-4778-997b-390c355e73aa tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:56.272928 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d3987d3d-836d-4778-997b-390c355e73aa tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:56.274152 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d3987d3d-836d-4778-997b-390c355e73aa tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:56.275047 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d3987d3d-836d-4778-997b-390c355e73aa tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:56.437215 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d3987d3d-836d-4778-997b-390c355e73aa tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:56.448449 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-d3987d3d-836d-4778-997b-390c355e73aa tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1549 microversion: 2.1 time: 0.192955 Jun 24 10:01:56.449695 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 83/177] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:56 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1549 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:56.453670 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-a233e085-96f9-4aa6-861e-2b937dceda10 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:56.454209 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-a233e085-96f9-4aa6-861e-2b937dceda10 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:56.461148 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a233e085-96f9-4aa6-861e-2b937dceda10 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:56.461600 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a233e085-96f9-4aa6-861e-2b937dceda10 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:56.462378 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a233e085-96f9-4aa6-861e-2b937dceda10 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:56.462819 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a233e085-96f9-4aa6-861e-2b937dceda10 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:56.478212 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-7d4ebd39-3033-4ea9-b5fa-207bde165e37 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "POST /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.077904 Jun 24 10:01:56.478986 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 95/178] 10.222.0.26 () {60 vars in 1322 bytes} [Fri Jun 24 10:01:55 2022] POST /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a/os-volume_attachments => generated 194 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:56.494433 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-ffa2c1fb-d741-4d09-98df-1e10b2f23fec tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:56.495444 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-ffa2c1fb-d741-4d09-98df-1e10b2f23fec tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:56.505677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ffa2c1fb-d741-4d09-98df-1e10b2f23fec tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:56.506152 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ffa2c1fb-d741-4d09-98df-1e10b2f23fec tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:56.507440 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ffa2c1fb-d741-4d09-98df-1e10b2f23fec tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:56.507876 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ffa2c1fb-d741-4d09-98df-1e10b2f23fec tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:56.636938 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-ffa2c1fb-d741-4d09-98df-1e10b2f23fec tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.156587 Jun 24 10:01:56.643427 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-a233e085-96f9-4aa6-861e-2b937dceda10 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:56.644300 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 96/179] 10.222.0.26 () {58 vars in 1274 bytes} [Fri Jun 24 10:01:56 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e/os-interface => generated 285 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:56.647701 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-a233e085-96f9-4aa6-861e-2b937dceda10 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1321 microversion: 2.1 time: 0.197141 Jun 24 10:01:56.648294 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 84/180] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:56 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:57.274091 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-fb248cb2-02a4-4ad3-83f6-31ee5daeff7b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:57.274735 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-fb248cb2-02a4-4ad3-83f6-31ee5daeff7b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:57.281356 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fb248cb2-02a4-4ad3-83f6-31ee5daeff7b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:57.281857 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fb248cb2-02a4-4ad3-83f6-31ee5daeff7b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:57.282677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fb248cb2-02a4-4ad3-83f6-31ee5daeff7b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:57.283194 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fb248cb2-02a4-4ad3-83f6-31ee5daeff7b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:57.475459 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-fb248cb2-02a4-4ad3-83f6-31ee5daeff7b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:57.480474 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-fb248cb2-02a4-4ad3-83f6-31ee5daeff7b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:57.482066 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-fb248cb2-02a4-4ad3-83f6-31ee5daeff7b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:57.483168 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-fb248cb2-02a4-4ad3-83f6-31ee5daeff7b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1405 microversion: 2.20 time: 0.214152 Jun 24 10:01:57.483731 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 97/181] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:01:57 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1405 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:01:57.664885 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-f67285d1-7424-42b1-90a4-499bdffc2e88 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:57.665643 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-f67285d1-7424-42b1-90a4-499bdffc2e88 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:57.684812 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f67285d1-7424-42b1-90a4-499bdffc2e88 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:57.684812 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f67285d1-7424-42b1-90a4-499bdffc2e88 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:57.684812 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f67285d1-7424-42b1-90a4-499bdffc2e88 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:57.684812 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f67285d1-7424-42b1-90a4-499bdffc2e88 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:57.828022 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-f67285d1-7424-42b1-90a4-499bdffc2e88 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:57.836179 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-f67285d1-7424-42b1-90a4-499bdffc2e88 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1321 microversion: 2.1 time: 0.175862 Jun 24 10:01:57.836768 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 85/182] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:57 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:01:58.141064 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-710f4cf8-4aef-4fd1-9506-e0897c815357 req-944f29d3-3a45-4b2c-b855-9b4a0c57322b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84bc600e-1c87-4ba3-9dfa-421ee774e45e", "tag": "9e3214ad-2d0a-4c9c-aa84-e405ba29e4b8"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:01:58.149394 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-710f4cf8-4aef-4fd1-9506-e0897c815357 req-944f29d3-3a45-4b2c-b855-9b4a0c57322b service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:58.149834 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-710f4cf8-4aef-4fd1-9506-e0897c815357 req-944f29d3-3a45-4b2c-b855-9b4a0c57322b service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:58.161798 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-710f4cf8-4aef-4fd1-9506-e0897c815357 req-944f29d3-3a45-4b2c-b855-9b4a0c57322b service nova] Creating event network-changed:9e3214ad-2d0a-4c9c-aa84-e405ba29e4b8 for instance 84bc600e-1c87-4ba3-9dfa-421ee774e45e on hv-cinder-84327 Jun 24 10:01:58.168277 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-710f4cf8-4aef-4fd1-9506-e0897c815357 req-944f29d3-3a45-4b2c-b855-9b4a0c57322b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030910 Jun 24 10:01:58.169370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 98/183] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:01:58.507969 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-a27be412-715d-4b19-af23-6646a576f894 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:58.508890 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-a27be412-715d-4b19-af23-6646a576f894 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:58.517067 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a27be412-715d-4b19-af23-6646a576f894 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:58.518010 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a27be412-715d-4b19-af23-6646a576f894 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:58.519245 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a27be412-715d-4b19-af23-6646a576f894 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:58.519694 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a27be412-715d-4b19-af23-6646a576f894 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:58.711560 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-a27be412-715d-4b19-af23-6646a576f894 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:58.723399 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-a27be412-715d-4b19-af23-6646a576f894 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:58.724928 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-a27be412-715d-4b19-af23-6646a576f894 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:58.726596 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-a27be412-715d-4b19-af23-6646a576f894 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1597 microversion: 2.20 time: 0.228935 Jun 24 10:01:58.739679 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 86/184] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:01:58 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1597 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:01:58.746685 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-cb4e4416-9787-4808-8a90-9b9cd42aabbf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:58.747267 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-cb4e4416-9787-4808-8a90-9b9cd42aabbf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:58.758687 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-cb4e4416-9787-4808-8a90-9b9cd42aabbf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:58.759867 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-cb4e4416-9787-4808-8a90-9b9cd42aabbf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:58.761387 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-cb4e4416-9787-4808-8a90-9b9cd42aabbf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:58.765077 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-cb4e4416-9787-4808-8a90-9b9cd42aabbf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:58.857111 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-e738069d-809e-4c0d-8a4e-c56ae1e2e3bc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:58.857762 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-e738069d-809e-4c0d-8a4e-c56ae1e2e3bc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:58.867647 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e738069d-809e-4c0d-8a4e-c56ae1e2e3bc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:58.868099 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e738069d-809e-4c0d-8a4e-c56ae1e2e3bc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:58.871549 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e738069d-809e-4c0d-8a4e-c56ae1e2e3bc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:58.872205 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e738069d-809e-4c0d-8a4e-c56ae1e2e3bc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:58.948843 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-cb4e4416-9787-4808-8a90-9b9cd42aabbf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.207514 Jun 24 10:01:58.953407 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 99/185] 10.222.0.26 () {60 vars in 1315 bytes} [Fri Jun 24 10:01:58 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877/os-interface => generated 284 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:01:59.203299 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-e738069d-809e-4c0d-8a4e-c56ae1e2e3bc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:01:59.213641 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-e738069d-809e-4c0d-8a4e-c56ae1e2e3bc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1515 microversion: 2.1 time: 0.362167 Jun 24 10:01:59.215286 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 87/186] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:58 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1515 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:01:59.237692 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-49717c2a-c789-41de-82cf-8677238d1b48 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:01:59.238963 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-49717c2a-c789-41de-82cf-8677238d1b48 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:59.250858 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-49717c2a-c789-41de-82cf-8677238d1b48 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:59.251320 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-49717c2a-c789-41de-82cf-8677238d1b48 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:59.252096 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-49717c2a-c789-41de-82cf-8677238d1b48 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:59.252565 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-49717c2a-c789-41de-82cf-8677238d1b48 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:59.313253 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.objects.instance [None req-49717c2a-c789-41de-82cf-8677238d1b48 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lazy-loading 'flavor' on Instance uuid e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb {{(pid=124979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:01:59.722898 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-49717c2a-c789-41de-82cf-8677238d1b48 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "POST /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb/action" status: 200 len: 32 microversion: 2.1 time: 0.489598 Jun 24 10:01:59.724631 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 100/187] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Jun 24 10:01:59 2022] POST /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb/action => generated 32 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 10:01:59.732610 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-efe700b4-1d95-4432-8a21-b1ddb08ad321 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:01:59.733229 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-efe700b4-1d95-4432-8a21-b1ddb08ad321 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:01:59.739498 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-efe700b4-1d95-4432-8a21-b1ddb08ad321 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:59.739868 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-efe700b4-1d95-4432-8a21-b1ddb08ad321 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:01:59.740884 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-efe700b4-1d95-4432-8a21-b1ddb08ad321 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:01:59.741191 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-efe700b4-1d95-4432-8a21-b1ddb08ad321 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:00.021265 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-efe700b4-1d95-4432-8a21-b1ddb08ad321 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:00.048232 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-efe700b4-1d95-4432-8a21-b1ddb08ad321 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1521 microversion: 2.1 time: 0.318344 Jun 24 10:02:00.048835 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 88/188] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:01:59 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:00.632688 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-358c472d-6216-49d9-8046-29de9ce8a11d req-bcb5a47b-32c5-4e5b-84b7-8084c3f6d5cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "904eb348-521e-499e-8127-cb3096230877", "tag": "bc68c0d7-3cc3-4add-8d35-8b1892ac129e"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:02:00.649664 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-358c472d-6216-49d9-8046-29de9ce8a11d req-bcb5a47b-32c5-4e5b-84b7-8084c3f6d5cb service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:00.650607 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-358c472d-6216-49d9-8046-29de9ce8a11d req-bcb5a47b-32c5-4e5b-84b7-8084c3f6d5cb service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:00.667595 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-358c472d-6216-49d9-8046-29de9ce8a11d req-bcb5a47b-32c5-4e5b-84b7-8084c3f6d5cb service nova] Creating event network-changed:bc68c0d7-3cc3-4add-8d35-8b1892ac129e for instance 904eb348-521e-499e-8127-cb3096230877 on hv-cinder-84327 Jun 24 10:02:00.673886 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-358c472d-6216-49d9-8046-29de9ce8a11d req-bcb5a47b-32c5-4e5b-84b7-8084c3f6d5cb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045098 Jun 24 10:02:00.677774 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 101/189] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:02:01.090242 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-28c63167-4d59-40b6-99fd-6e0ddb8f6f9f tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:01.090919 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-28c63167-4d59-40b6-99fd-6e0ddb8f6f9f tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:01.100534 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell0:SELECT=2 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:02:01.101297 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_api:SELECT=99 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:02:01.108283 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-28c63167-4d59-40b6-99fd-6e0ddb8f6f9f tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:01.108912 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-28c63167-4d59-40b6-99fd-6e0ddb8f6f9f tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:01.110231 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-28c63167-4d59-40b6-99fd-6e0ddb8f6f9f tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:01.110680 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-28c63167-4d59-40b6-99fd-6e0ddb8f6f9f tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:01.394139 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-28c63167-4d59-40b6-99fd-6e0ddb8f6f9f tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:01.407777 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-28c63167-4d59-40b6-99fd-6e0ddb8f6f9f tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1521 microversion: 2.1 time: 0.340351 Jun 24 10:02:01.409543 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 89/190] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:01 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:02.427440 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-62f9663c-e9a8-4bdc-8619-ff5f97415166 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:02.429232 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-62f9663c-e9a8-4bdc-8619-ff5f97415166 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:02.436337 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-62f9663c-e9a8-4bdc-8619-ff5f97415166 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:02.436829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-62f9663c-e9a8-4bdc-8619-ff5f97415166 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:02.437555 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-62f9663c-e9a8-4bdc-8619-ff5f97415166 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:02.437992 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-62f9663c-e9a8-4bdc-8619-ff5f97415166 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:02.613008 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-62f9663c-e9a8-4bdc-8619-ff5f97415166 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:02.622368 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-62f9663c-e9a8-4bdc-8619-ff5f97415166 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1521 microversion: 2.1 time: 0.198981 Jun 24 10:02:02.624822 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 102/191] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:02 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:03.643211 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-592cedeb-b9ae-470e-aebf-392474e7ae11 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:03.643861 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-592cedeb-b9ae-470e-aebf-392474e7ae11 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:03.650674 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-592cedeb-b9ae-470e-aebf-392474e7ae11 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:03.651119 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-592cedeb-b9ae-470e-aebf-392474e7ae11 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:03.651880 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-592cedeb-b9ae-470e-aebf-392474e7ae11 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:03.652483 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-592cedeb-b9ae-470e-aebf-392474e7ae11 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:03.786329 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-592cedeb-b9ae-470e-aebf-392474e7ae11 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:03.794526 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-592cedeb-b9ae-470e-aebf-392474e7ae11 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1521 microversion: 2.1 time: 0.155467 Jun 24 10:02:03.795091 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 90/192] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:03 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:04.810642 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-44f30ecc-ed28-468d-9d1f-0cbefd4d67c8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:04.811259 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-44f30ecc-ed28-468d-9d1f-0cbefd4d67c8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:04.817794 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-44f30ecc-ed28-468d-9d1f-0cbefd4d67c8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:04.818761 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-44f30ecc-ed28-468d-9d1f-0cbefd4d67c8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:04.819526 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-44f30ecc-ed28-468d-9d1f-0cbefd4d67c8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:04.819967 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-44f30ecc-ed28-468d-9d1f-0cbefd4d67c8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:04.942873 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-44f30ecc-ed28-468d-9d1f-0cbefd4d67c8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:04.950849 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-44f30ecc-ed28-468d-9d1f-0cbefd4d67c8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1521 microversion: 2.1 time: 0.144152 Jun 24 10:02:04.951404 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 103/193] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:04 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:05.968023 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-91edc837-eeaf-4b42-b207-a5da201ce9df tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:05.968667 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-91edc837-eeaf-4b42-b207-a5da201ce9df tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:05.975604 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-91edc837-eeaf-4b42-b207-a5da201ce9df tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:05.976061 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-91edc837-eeaf-4b42-b207-a5da201ce9df tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:05.976903 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-91edc837-eeaf-4b42-b207-a5da201ce9df tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:05.977344 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-91edc837-eeaf-4b42-b207-a5da201ce9df tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:06.106807 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-91edc837-eeaf-4b42-b207-a5da201ce9df tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:06.114351 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-91edc837-eeaf-4b42-b207-a5da201ce9df tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1521 microversion: 2.1 time: 0.150111 Jun 24 10:02:06.115434 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 91/194] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:05 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:07.131566 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-3771005e-0b9f-4798-bfc6-6db7822720cb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:07.132200 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-3771005e-0b9f-4798-bfc6-6db7822720cb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:07.134652 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_api:SELECT=93 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:02:07.140495 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3771005e-0b9f-4798-bfc6-6db7822720cb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:07.140948 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3771005e-0b9f-4798-bfc6-6db7822720cb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:07.141769 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3771005e-0b9f-4798-bfc6-6db7822720cb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:07.142210 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3771005e-0b9f-4798-bfc6-6db7822720cb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:07.273585 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-3771005e-0b9f-4798-bfc6-6db7822720cb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:07.276989 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:02:07.281349 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-3771005e-0b9f-4798-bfc6-6db7822720cb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1521 microversion: 2.1 time: 0.154502 Jun 24 10:02:07.281876 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 104/195] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:07 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:08.298256 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-973b9699-d94b-4f2d-9a8a-8f4344d8471e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:08.298873 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-973b9699-d94b-4f2d-9a8a-8f4344d8471e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:08.305896 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-973b9699-d94b-4f2d-9a8a-8f4344d8471e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:08.306287 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-973b9699-d94b-4f2d-9a8a-8f4344d8471e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:08.307051 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-973b9699-d94b-4f2d-9a8a-8f4344d8471e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:08.307525 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-973b9699-d94b-4f2d-9a8a-8f4344d8471e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:08.440070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-973b9699-d94b-4f2d-9a8a-8f4344d8471e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:08.447496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-973b9699-d94b-4f2d-9a8a-8f4344d8471e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1521 microversion: 2.1 time: 0.153072 Jun 24 10:02:08.448050 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 92/196] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:08 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:09.465792 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-d955cba3-eb54-4cc3-84c2-bddc2c9043c8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:09.466444 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-d955cba3-eb54-4cc3-84c2-bddc2c9043c8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:09.473587 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d955cba3-eb54-4cc3-84c2-bddc2c9043c8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:09.474307 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d955cba3-eb54-4cc3-84c2-bddc2c9043c8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:09.475084 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d955cba3-eb54-4cc3-84c2-bddc2c9043c8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:09.475560 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d955cba3-eb54-4cc3-84c2-bddc2c9043c8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:09.815029 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d955cba3-eb54-4cc3-84c2-bddc2c9043c8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:09.815029 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-d955cba3-eb54-4cc3-84c2-bddc2c9043c8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1521 microversion: 2.1 time: 0.151140 Jun 24 10:02:09.815029 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 105/197] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:09 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:10.629444 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-12e66a20-f116-4461-87ff-5a4e46717bab tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:10.630130 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-12e66a20-f116-4461-87ff-5a4e46717bab tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:10.637773 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-12e66a20-f116-4461-87ff-5a4e46717bab tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:10.638217 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-12e66a20-f116-4461-87ff-5a4e46717bab tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:10.639007 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-12e66a20-f116-4461-87ff-5a4e46717bab tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:10.639441 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-12e66a20-f116-4461-87ff-5a4e46717bab tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:10.771223 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-12e66a20-f116-4461-87ff-5a4e46717bab tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:10.778863 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-12e66a20-f116-4461-87ff-5a4e46717bab tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1521 microversion: 2.1 time: 0.153388 Jun 24 10:02:10.779431 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 93/198] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:10 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:11.796975 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-e68895c4-8e11-431a-9b96-c88ab939d878 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:11.797636 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-e68895c4-8e11-431a-9b96-c88ab939d878 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:11.805429 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e68895c4-8e11-431a-9b96-c88ab939d878 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:11.809290 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e68895c4-8e11-431a-9b96-c88ab939d878 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:11.809290 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e68895c4-8e11-431a-9b96-c88ab939d878 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:11.809290 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e68895c4-8e11-431a-9b96-c88ab939d878 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:11.846331 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-d96794b4-07fc-432a-92f7-cb4aba2daeb2 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:11.846870 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-d96794b4-07fc-432a-92f7-cb4aba2daeb2 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:11.874955 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d96794b4-07fc-432a-92f7-cb4aba2daeb2 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:11.877475 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d96794b4-07fc-432a-92f7-cb4aba2daeb2 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:11.878464 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d96794b4-07fc-432a-92f7-cb4aba2daeb2 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:11.888786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d96794b4-07fc-432a-92f7-cb4aba2daeb2 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:11.930052 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-d96794b4-07fc-432a-92f7-cb4aba2daeb2 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Going to try to terminate instance {{(pid=124980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:02:11.990507 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-e68895c4-8e11-431a-9b96-c88ab939d878 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:11.999822 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-e68895c4-8e11-431a-9b96-c88ab939d878 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1521 microversion: 2.1 time: 0.207007 Jun 24 10:02:12.004253 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 106/199] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:11 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:12.104280 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:02:12.271513 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-d96794b4-07fc-432a-92f7-cb4aba2daeb2 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 204 len: 0 microversion: 2.1 time: 0.428235 Jun 24 10:02:12.272222 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 94/200] 10.222.0.26 () {58 vars in 1238 bytes} [Fri Jun 24 10:02:11 2022] DELETE /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:02:12.280712 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-e03ac05e-3c17-4b3c-94a6-0fc3adf642d0 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:12.281401 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-e03ac05e-3c17-4b3c-94a6-0fc3adf642d0 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:12.287805 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e03ac05e-3c17-4b3c-94a6-0fc3adf642d0 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:12.288233 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e03ac05e-3c17-4b3c-94a6-0fc3adf642d0 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:12.288987 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e03ac05e-3c17-4b3c-94a6-0fc3adf642d0 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:12.289448 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e03ac05e-3c17-4b3c-94a6-0fc3adf642d0 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:12.420984 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-e03ac05e-3c17-4b3c-94a6-0fc3adf642d0 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:12.428910 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-e03ac05e-3c17-4b3c-94a6-0fc3adf642d0 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1554 microversion: 2.1 time: 0.152297 Jun 24 10:02:12.432647 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 107/201] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:12 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:13.018440 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-ec3396e5-b01e-46b2-9aa8-1938bef3856b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:13.019291 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-ec3396e5-b01e-46b2-9aa8-1938bef3856b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:13.026878 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ec3396e5-b01e-46b2-9aa8-1938bef3856b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:13.027437 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ec3396e5-b01e-46b2-9aa8-1938bef3856b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:13.028248 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ec3396e5-b01e-46b2-9aa8-1938bef3856b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:13.028693 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ec3396e5-b01e-46b2-9aa8-1938bef3856b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:13.175425 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-ec3396e5-b01e-46b2-9aa8-1938bef3856b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:13.183248 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-ec3396e5-b01e-46b2-9aa8-1938bef3856b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1521 microversion: 2.1 time: 0.169917 Jun 24 10:02:13.193133 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 95/202] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:13 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:13.447282 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-559f49e2-c551-4032-b731-fc89639ec6d7 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:13.448015 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-559f49e2-c551-4032-b731-fc89639ec6d7 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:13.454618 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-559f49e2-c551-4032-b731-fc89639ec6d7 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:13.455073 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-559f49e2-c551-4032-b731-fc89639ec6d7 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:13.455857 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-559f49e2-c551-4032-b731-fc89639ec6d7 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:13.456329 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-559f49e2-c551-4032-b731-fc89639ec6d7 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:13.587791 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-559f49e2-c551-4032-b731-fc89639ec6d7 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:13.596677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-559f49e2-c551-4032-b731-fc89639ec6d7 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1554 microversion: 2.1 time: 0.153815 Jun 24 10:02:13.597243 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 108/203] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:13 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:14.200408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-af2906f2-34ed-41ae-8b1e-2930fbd18965 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:14.202364 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-af2906f2-34ed-41ae-8b1e-2930fbd18965 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:14.210066 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-af2906f2-34ed-41ae-8b1e-2930fbd18965 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:14.210757 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-af2906f2-34ed-41ae-8b1e-2930fbd18965 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:14.215427 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-af2906f2-34ed-41ae-8b1e-2930fbd18965 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:14.215905 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-af2906f2-34ed-41ae-8b1e-2930fbd18965 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:14.368656 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-af2906f2-34ed-41ae-8b1e-2930fbd18965 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:14.376384 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-af2906f2-34ed-41ae-8b1e-2930fbd18965 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1521 microversion: 2.1 time: 0.179990 Jun 24 10:02:14.376961 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 96/204] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:14 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:14.621340 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-d5368e87-d804-499b-ba57-a9d50095617a tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:14.621340 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-d5368e87-d804-499b-ba57-a9d50095617a tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:14.626243 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d5368e87-d804-499b-ba57-a9d50095617a tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:14.626243 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d5368e87-d804-499b-ba57-a9d50095617a tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:14.626243 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d5368e87-d804-499b-ba57-a9d50095617a tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:14.626243 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d5368e87-d804-499b-ba57-a9d50095617a tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:14.896950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d5368e87-d804-499b-ba57-a9d50095617a tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:14.907048 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-d5368e87-d804-499b-ba57-a9d50095617a tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1554 microversion: 2.1 time: 0.296456 Jun 24 10:02:14.908945 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 109/205] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:14 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1554 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:15.392507 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-92d0a51a-62d9-4742-a52e-f23e4815abf7 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:15.393153 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-92d0a51a-62d9-4742-a52e-f23e4815abf7 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:15.400295 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-92d0a51a-62d9-4742-a52e-f23e4815abf7 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:15.400754 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-92d0a51a-62d9-4742-a52e-f23e4815abf7 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:15.401565 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-92d0a51a-62d9-4742-a52e-f23e4815abf7 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:15.402181 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-92d0a51a-62d9-4742-a52e-f23e4815abf7 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:15.560428 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-92d0a51a-62d9-4742-a52e-f23e4815abf7 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:15.569983 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-92d0a51a-62d9-4742-a52e-f23e4815abf7 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1521 microversion: 2.1 time: 0.181025 Jun 24 10:02:15.579266 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 97/206] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:15 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:15.745218 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-d7a9706e-8b4a-4f5c-9a0b-8c7ecb918538 req-38600eb8-8188-4135-b045-5c099bb258af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffd6d45e-4648-4b13-acb5-3473bf9e935a", "name": "network-vif-deleted", "tag": "ac909eb0-aeea-4b66-970c-1e6b004e8902"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:02:15.755813 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-d7a9706e-8b4a-4f5c-9a0b-8c7ecb918538 req-38600eb8-8188-4135-b045-5c099bb258af service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:15.756376 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-d7a9706e-8b4a-4f5c-9a0b-8c7ecb918538 req-38600eb8-8188-4135-b045-5c099bb258af service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:15.768611 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-d7a9706e-8b4a-4f5c-9a0b-8c7ecb918538 req-38600eb8-8188-4135-b045-5c099bb258af service nova] Creating event network-vif-deleted:ac909eb0-aeea-4b66-970c-1e6b004e8902 for instance ffd6d45e-4648-4b13-acb5-3473bf9e935a on hv-cinder-84327 Jun 24 10:02:15.774073 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-d7a9706e-8b4a-4f5c-9a0b-8c7ecb918538 req-38600eb8-8188-4135-b045-5c099bb258af service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038819 Jun 24 10:02:15.774739 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 110/207] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:02:15.934507 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-862243a3-1661-46c4-9e83-cda35a08dc9f tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:15.938195 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-862243a3-1661-46c4-9e83-cda35a08dc9f tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:15.950536 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-862243a3-1661-46c4-9e83-cda35a08dc9f tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:15.959140 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-862243a3-1661-46c4-9e83-cda35a08dc9f tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:15.959140 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-862243a3-1661-46c4-9e83-cda35a08dc9f tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:15.959140 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-862243a3-1661-46c4-9e83-cda35a08dc9f tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:16.027062 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-862243a3-1661-46c4-9e83-cda35a08dc9f tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:16.035129 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-862243a3-1661-46c4-9e83-cda35a08dc9f tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1345 microversion: 2.1 time: 0.111005 Jun 24 10:02:16.035822 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 98/208] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:15 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1345 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:16.587927 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-23be0e6d-3102-4e59-996b-fe4a03306155 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:16.588977 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-23be0e6d-3102-4e59-996b-fe4a03306155 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:16.595743 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-23be0e6d-3102-4e59-996b-fe4a03306155 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:16.596636 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-23be0e6d-3102-4e59-996b-fe4a03306155 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:16.597464 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-23be0e6d-3102-4e59-996b-fe4a03306155 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:16.598017 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-23be0e6d-3102-4e59-996b-fe4a03306155 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:16.741160 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-23be0e6d-3102-4e59-996b-fe4a03306155 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:16.753681 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-23be0e6d-3102-4e59-996b-fe4a03306155 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1521 microversion: 2.1 time: 0.170474 Jun 24 10:02:16.764083 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 111/209] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:16 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:17.055438 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-01190648-f7b7-4649-bcbc-08c42e9f0fca tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:17.057532 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-01190648-f7b7-4649-bcbc-08c42e9f0fca tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:17.065713 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-01190648-f7b7-4649-bcbc-08c42e9f0fca tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:17.066486 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-01190648-f7b7-4649-bcbc-08c42e9f0fca tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:17.068987 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-01190648-f7b7-4649-bcbc-08c42e9f0fca tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:17.069660 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-01190648-f7b7-4649-bcbc-08c42e9f0fca tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:17.109502 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-01190648-f7b7-4649-bcbc-08c42e9f0fca tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:17.110001 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-01190648-f7b7-4649-bcbc-08c42e9f0fca tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:17.110473 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.objects.instance [None req-01190648-f7b7-4649-bcbc-08c42e9f0fca tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lazy-loading 'fault' on Instance uuid ffd6d45e-4648-4b13-acb5-3473bf9e935a {{(pid=124980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:02:17.173476 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-01190648-f7b7-4649-bcbc-08c42e9f0fca tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e8b45e1b2524140bffcee941b151f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e8e5400d9ee4b6bbe129f4b7327cdf3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:17.182476 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-01190648-f7b7-4649-bcbc-08c42e9f0fca tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 200 len: 1350 microversion: 2.1 time: 0.132499 Jun 24 10:02:17.183054 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 99/210] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:17 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 1350 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:17.772224 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-152e83a2-25b5-4f39-883c-2b9e261a6ddb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:17.772966 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-152e83a2-25b5-4f39-883c-2b9e261a6ddb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:17.781427 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-152e83a2-25b5-4f39-883c-2b9e261a6ddb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:17.781884 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-152e83a2-25b5-4f39-883c-2b9e261a6ddb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:17.782649 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-152e83a2-25b5-4f39-883c-2b9e261a6ddb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:17.783292 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-152e83a2-25b5-4f39-883c-2b9e261a6ddb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:17.931307 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-152e83a2-25b5-4f39-883c-2b9e261a6ddb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:17.938891 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-152e83a2-25b5-4f39-883c-2b9e261a6ddb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1521 microversion: 2.1 time: 0.171219 Jun 24 10:02:17.939752 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 112/211] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:17 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:18.202244 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-625af576-96d3-479d-874a-a71b9c628bcc tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:18.203178 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-625af576-96d3-479d-874a-a71b9c628bcc tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:18.209251 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-625af576-96d3-479d-874a-a71b9c628bcc tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:18.209697 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-625af576-96d3-479d-874a-a71b9c628bcc tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:18.210444 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-625af576-96d3-479d-874a-a71b9c628bcc tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:18.210880 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-625af576-96d3-479d-874a-a71b9c628bcc tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:18.225148 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.wsgi [None req-625af576-96d3-479d-874a-a71b9c628bcc tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] HTTP exception thrown: Instance ffd6d45e-4648-4b13-acb5-3473bf9e935a could not be found. Jun 24 10:02:18.237391 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-625af576-96d3-479d-874a-a71b9c628bcc tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Request method failure captured: Jun 24 10:02:18.237391 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: request: GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a HTTP/1.1 Jun 24 10:02:18.237391 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept: application/json Jun 24 10:02:18.237391 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept-Encoding: identity Jun 24 10:02:18.237391 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Connection: close Jun 24 10:02:18.237391 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Length: 0 Jun 24 10:02:18.237391 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Type: application/json Jun 24 10:02:18.237391 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Host: 10.222.0.26 Jun 24 10:02:18.237391 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Openstack-System-Scope: None Jun 24 10:02:18.237391 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: User-Agent: python-urllib3/1.26.9 Jun 24 10:02:18.237391 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Auth-Token: gAAAAABitYtmks0EqEBJGHWUXtYlt9bafTPuNE8u-VP2rvBQdoT24DZg99LfZ5-SyxUJb2p8mVHMIJpFUqAZ8sZ2sr5Vc1Dl-khzCObIcscAtLhIcvArs9ufgiw19kTRvprHQF6ONgrCKbsL-bI5Og1qBk6nYXVttk01Zalvz88irrY3uJOEvys Jun 24 10:02:18.237391 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Id: None Jun 24 10:02:18.237391 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Name: None Jun 24 10:02:18.237391 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Identity-Status: Confirmed Jun 24 10:02:18.237391 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Is-Admin-Project: True Jun 24 10:02:18.237391 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Id: default Jun 24 10:02:18.237391 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Name: Default Jun 24 10:02:18.237391 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Id: 6e8e5400d9ee4b6bbe129f4b7327cdf3 Jun 24 10:02:18.237391 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Name: tempest-DeleteServersTestJSON-1227082699 Jun 24 10:02:18.237391 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Role: reader,member Jun 24 10:02:18.237391 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Roles: reader,member Jun 24 10:02:18.239054 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6e8e5400d9ee4b6bbe129f4b7327cdf3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6e8e5400d9ee4b6bbe129f4b7327cdf3", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6e8e5400d9ee4b6bbe129f4b7327cdf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6e8e5400d9ee4b6bbe129f4b7327cdf3"}]}] Jun 24 10:02:18.239054 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant: tempest-DeleteServersTestJSON-1227082699 Jun 24 10:02:18.239054 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Id: 6e8e5400d9ee4b6bbe129f4b7327cdf3 Jun 24 10:02:18.239054 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Name: tempest-DeleteServersTestJSON-1227082699 Jun 24 10:02:18.239054 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User: tempest-DeleteServersTestJSON-1227082699-project Jun 24 10:02:18.239054 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Id: default Jun 24 10:02:18.239054 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Name: Default Jun 24 10:02:18.239054 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Id: 9e8b45e1b2524140bffcee941b151f24 Jun 24 10:02:18.239054 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Name: tempest-DeleteServersTestJSON-1227082699-project Jun 24 10:02:18.239054 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: method: > Jun 24 10:02:18.239054 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: exception: Instance ffd6d45e-4648-4b13-acb5-3473bf9e935a could not be found. Jun 24 10:02:18.239054 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: action_args: {'id': 'ffd6d45e-4648-4b13-acb5-3473bf9e935a'} Jun 24 10:02:18.240527 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:02:18.240527 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:02:18.240527 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:02:18.240527 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:02:18.240527 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:02:18.240527 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:02:18.240527 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:02:18.240527 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:02:18.240527 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:02:18.240527 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:02:18.240527 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffd6d45e-4648-4b13-acb5-3473bf9e935a could not be found. Jun 24 10:02:18.240527 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:02:18.240527 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:02:18.240527 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:02:18.240527 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:02:18.240527 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:02:18.240527 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:02:18.240527 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:02:18.240527 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:02:18.240527 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:02:18.241956 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:02:18.241956 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:02:18.241956 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:02:18.241956 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:02:18.241956 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:02:18.241956 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:02:18.241956 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:02:18.241956 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffd6d45e-4648-4b13-acb5-3473bf9e935a could not be found. Jun 24 10:02:18.241956 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:02:18.241956 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:02:18.241956 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:02:18.241956 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:02:18.241956 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:02:18.241956 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:02:18.241956 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:02:18.241956 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:02:18.241956 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffd6d45e-4648-4b13-acb5-3473bf9e935a could not be found. Jun 24 10:02:18.241956 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:02:18.243043 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-625af576-96d3-479d-874a-a71b9c628bcc tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Returning 404 to user: Instance ffd6d45e-4648-4b13-acb5-3473bf9e935a could not be found. {{(pid=124980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:02:18.243043 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-625af576-96d3-479d-874a-a71b9c628bcc tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 404 len: 111 microversion: 2.1 time: 0.040641 Jun 24 10:02:18.243043 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 100/212] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:18 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:02:18.344023 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-72f8fbc5-4866-4639-b524-a56e12619002 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:18.344969 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-72f8fbc5-4866-4639-b524-a56e12619002 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:18.351571 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-72f8fbc5-4866-4639-b524-a56e12619002 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:18.352030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-72f8fbc5-4866-4639-b524-a56e12619002 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:18.353055 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-72f8fbc5-4866-4639-b524-a56e12619002 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:18.353500 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-72f8fbc5-4866-4639-b524-a56e12619002 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:18.366103 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-72f8fbc5-4866-4639-b524-a56e12619002 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] HTTP exception thrown: Instance ffd6d45e-4648-4b13-acb5-3473bf9e935a could not be found. Jun 24 10:02:18.370118 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-72f8fbc5-4866-4639-b524-a56e12619002 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Request method failure captured: Jun 24 10:02:18.370118 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a/os-volume_attachments HTTP/1.1 Jun 24 10:02:18.370118 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:02:18.370118 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:02:18.370118 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:02:18.370118 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 0 Jun 24 10:02:18.370118 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:02:18.370118 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:02:18.370118 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:02:18.370118 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:02:18.370118 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitYtmks0EqEBJGHWUXtYlt9bafTPuNE8u-VP2rvBQdoT24DZg99LfZ5-SyxUJb2p8mVHMIJpFUqAZ8sZ2sr5Vc1Dl-khzCObIcscAtLhIcvArs9ufgiw19kTRvprHQF6ONgrCKbsL-bI5Og1qBk6nYXVttk01Zalvz88irrY3uJOEvys Jun 24 10:02:18.370118 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:02:18.370118 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:02:18.370118 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:02:18.370118 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:02:18.370118 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:02:18.370118 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:02:18.370118 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: 6e8e5400d9ee4b6bbe129f4b7327cdf3 Jun 24 10:02:18.370118 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-DeleteServersTestJSON-1227082699 Jun 24 10:02:18.370118 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:02:18.370118 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:02:18.371715 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6e8e5400d9ee4b6bbe129f4b7327cdf3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6e8e5400d9ee4b6bbe129f4b7327cdf3", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6e8e5400d9ee4b6bbe129f4b7327cdf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6e8e5400d9ee4b6bbe129f4b7327cdf3"}]}] Jun 24 10:02:18.371715 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-DeleteServersTestJSON-1227082699 Jun 24 10:02:18.371715 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: 6e8e5400d9ee4b6bbe129f4b7327cdf3 Jun 24 10:02:18.371715 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-DeleteServersTestJSON-1227082699 Jun 24 10:02:18.371715 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-DeleteServersTestJSON-1227082699-project Jun 24 10:02:18.371715 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:02:18.371715 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:02:18.371715 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: 9e8b45e1b2524140bffcee941b151f24 Jun 24 10:02:18.371715 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-DeleteServersTestJSON-1227082699-project Jun 24 10:02:18.371715 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: > Jun 24 10:02:18.371715 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Instance ffd6d45e-4648-4b13-acb5-3473bf9e935a could not be found. Jun 24 10:02:18.371715 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'server_id': 'ffd6d45e-4648-4b13-acb5-3473bf9e935a'} Jun 24 10:02:18.372497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:02:18.372497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:02:18.372497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:02:18.372497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:02:18.372497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:02:18.372497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:02:18.372497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:02:18.372497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:02:18.372497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:02:18.372497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:02:18.372497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffd6d45e-4648-4b13-acb5-3473bf9e935a could not be found. Jun 24 10:02:18.372497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:02:18.372497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:02:18.372497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:02:18.372497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:02:18.372497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:02:18.372497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:02:18.372497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:02:18.372497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:02:18.372497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:02:18.373606 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:02:18.373606 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 24 10:02:18.373606 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:02:18.373606 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 24 10:02:18.373606 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:02:18.373606 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 24 10:02:18.373606 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 24 10:02:18.373606 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:02:18.373606 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:02:18.373606 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffd6d45e-4648-4b13-acb5-3473bf9e935a could not be found. Jun 24 10:02:18.373606 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:02:18.373606 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:02:18.373606 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:02:18.373606 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:02:18.373606 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:02:18.373606 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:02:18.373606 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:02:18.373606 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:02:18.373606 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffd6d45e-4648-4b13-acb5-3473bf9e935a could not be found. Jun 24 10:02:18.373606 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:02:18.375666 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-72f8fbc5-4866-4639-b524-a56e12619002 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Returning 404 to user: Instance ffd6d45e-4648-4b13-acb5-3473bf9e935a could not be found. {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:02:18.375666 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-72f8fbc5-4866-4639-b524-a56e12619002 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031514 Jun 24 10:02:18.375666 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 113/213] 10.222.0.26 () {58 vars in 1301 bytes} [Fri Jun 24 10:02:18 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:02:18.956043 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-804250d6-b30f-45a7-8c07-69c5a918c560 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:18.956835 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-804250d6-b30f-45a7-8c07-69c5a918c560 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:18.963184 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-804250d6-b30f-45a7-8c07-69c5a918c560 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:18.963682 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-804250d6-b30f-45a7-8c07-69c5a918c560 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:18.964623 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-804250d6-b30f-45a7-8c07-69c5a918c560 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:18.965061 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-804250d6-b30f-45a7-8c07-69c5a918c560 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:19.126360 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-804250d6-b30f-45a7-8c07-69c5a918c560 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:19.136848 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-804250d6-b30f-45a7-8c07-69c5a918c560 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1521 microversion: 2.1 time: 0.184721 Jun 24 10:02:19.141716 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 101/214] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:18 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:19.756552 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-247df8a0-c8b4-40c4-93e6-8cbbdc5ee1df tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:19.757138 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-247df8a0-c8b4-40c4-93e6-8cbbdc5ee1df tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:19.764023 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-247df8a0-c8b4-40c4-93e6-8cbbdc5ee1df tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:19.764571 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-247df8a0-c8b4-40c4-93e6-8cbbdc5ee1df tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:19.765482 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-247df8a0-c8b4-40c4-93e6-8cbbdc5ee1df tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:19.765918 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-247df8a0-c8b4-40c4-93e6-8cbbdc5ee1df tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:19.790303 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-247df8a0-c8b4-40c4-93e6-8cbbdc5ee1df tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] HTTP exception thrown: Instance ffd6d45e-4648-4b13-acb5-3473bf9e935a could not be found. Jun 24 10:02:19.792993 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-247df8a0-c8b4-40c4-93e6-8cbbdc5ee1df tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Request method failure captured: Jun 24 10:02:19.792993 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: DELETE /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a HTTP/1.1 Jun 24 10:02:19.792993 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:02:19.792993 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:02:19.792993 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:02:19.792993 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 0 Jun 24 10:02:19.792993 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:02:19.792993 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:02:19.792993 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:02:19.792993 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:02:19.792993 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitYtmks0EqEBJGHWUXtYlt9bafTPuNE8u-VP2rvBQdoT24DZg99LfZ5-SyxUJb2p8mVHMIJpFUqAZ8sZ2sr5Vc1Dl-khzCObIcscAtLhIcvArs9ufgiw19kTRvprHQF6ONgrCKbsL-bI5Og1qBk6nYXVttk01Zalvz88irrY3uJOEvys Jun 24 10:02:19.792993 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:02:19.792993 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:02:19.792993 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:02:19.792993 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:02:19.792993 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:02:19.792993 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:02:19.792993 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: 6e8e5400d9ee4b6bbe129f4b7327cdf3 Jun 24 10:02:19.792993 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-DeleteServersTestJSON-1227082699 Jun 24 10:02:19.792993 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:02:19.792993 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:02:19.794844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6e8e5400d9ee4b6bbe129f4b7327cdf3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6e8e5400d9ee4b6bbe129f4b7327cdf3", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6e8e5400d9ee4b6bbe129f4b7327cdf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6e8e5400d9ee4b6bbe129f4b7327cdf3"}]}] Jun 24 10:02:19.794844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-DeleteServersTestJSON-1227082699 Jun 24 10:02:19.794844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: 6e8e5400d9ee4b6bbe129f4b7327cdf3 Jun 24 10:02:19.794844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-DeleteServersTestJSON-1227082699 Jun 24 10:02:19.794844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-DeleteServersTestJSON-1227082699-project Jun 24 10:02:19.794844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:02:19.794844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:02:19.794844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: 9e8b45e1b2524140bffcee941b151f24 Jun 24 10:02:19.794844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-DeleteServersTestJSON-1227082699-project Jun 24 10:02:19.794844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: > Jun 24 10:02:19.794844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Instance ffd6d45e-4648-4b13-acb5-3473bf9e935a could not be found. Jun 24 10:02:19.794844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'id': 'ffd6d45e-4648-4b13-acb5-3473bf9e935a'} Jun 24 10:02:19.796008 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:02:19.796008 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:02:19.796008 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:02:19.796008 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:02:19.796008 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:02:19.796008 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:02:19.796008 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:02:19.796008 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:02:19.796008 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:02:19.796008 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:02:19.796008 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffd6d45e-4648-4b13-acb5-3473bf9e935a could not be found. Jun 24 10:02:19.796008 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:02:19.796008 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:02:19.796008 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:02:19.796008 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:02:19.796008 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:02:19.796008 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:02:19.796008 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:02:19.796008 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:02:19.796008 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:02:19.797438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:02:19.797438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 10:02:19.797438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 10:02:19.797438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 10:02:19.797438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 10:02:19.797438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:02:19.797438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:02:19.797438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:02:19.797438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:02:19.797438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffd6d45e-4648-4b13-acb5-3473bf9e935a could not be found. Jun 24 10:02:19.797438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:02:19.797438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:02:19.797438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:02:19.797438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:02:19.797438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:02:19.797438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:02:19.797438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:02:19.797438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:02:19.797438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffd6d45e-4648-4b13-acb5-3473bf9e935a could not be found. Jun 24 10:02:19.797438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:02:19.799027 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-247df8a0-c8b4-40c4-93e6-8cbbdc5ee1df tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Returning 404 to user: Instance ffd6d45e-4648-4b13-acb5-3473bf9e935a could not be found. {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:02:19.799027 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-247df8a0-c8b4-40c4-93e6-8cbbdc5ee1df tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 404 len: 111 microversion: 2.1 time: 0.044300 Jun 24 10:02:19.799027 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 114/215] 10.222.0.26 () {58 vars in 1238 bytes} [Fri Jun 24 10:02:19 2022] DELETE /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:02:19.811343 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-a17c609c-3d12-4df0-a5f9-62a85e69a305 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:19.811343 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-a17c609c-3d12-4df0-a5f9-62a85e69a305 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] [instance: ffd6d45e-4648-4b13-acb5-3473bf9e935a] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:19.812276 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a17c609c-3d12-4df0-a5f9-62a85e69a305 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:19.812807 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a17c609c-3d12-4df0-a5f9-62a85e69a305 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:19.813796 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a17c609c-3d12-4df0-a5f9-62a85e69a305 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:19.814460 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a17c609c-3d12-4df0-a5f9-62a85e69a305 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:19.829315 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.wsgi [None req-a17c609c-3d12-4df0-a5f9-62a85e69a305 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] HTTP exception thrown: Instance ffd6d45e-4648-4b13-acb5-3473bf9e935a could not be found. Jun 24 10:02:19.830971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-a17c609c-3d12-4df0-a5f9-62a85e69a305 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Request method failure captured: Jun 24 10:02:19.830971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: request: GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a HTTP/1.1 Jun 24 10:02:19.830971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept: application/json Jun 24 10:02:19.830971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept-Encoding: identity Jun 24 10:02:19.830971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Connection: close Jun 24 10:02:19.830971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Length: 0 Jun 24 10:02:19.830971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Type: application/json Jun 24 10:02:19.830971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Host: 10.222.0.26 Jun 24 10:02:19.830971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Openstack-System-Scope: None Jun 24 10:02:19.830971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: User-Agent: python-urllib3/1.26.9 Jun 24 10:02:19.830971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Auth-Token: gAAAAABitYtmks0EqEBJGHWUXtYlt9bafTPuNE8u-VP2rvBQdoT24DZg99LfZ5-SyxUJb2p8mVHMIJpFUqAZ8sZ2sr5Vc1Dl-khzCObIcscAtLhIcvArs9ufgiw19kTRvprHQF6ONgrCKbsL-bI5Og1qBk6nYXVttk01Zalvz88irrY3uJOEvys Jun 24 10:02:19.830971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Id: None Jun 24 10:02:19.830971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Name: None Jun 24 10:02:19.830971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Identity-Status: Confirmed Jun 24 10:02:19.830971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Is-Admin-Project: True Jun 24 10:02:19.830971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Id: default Jun 24 10:02:19.830971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Name: Default Jun 24 10:02:19.830971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Id: 6e8e5400d9ee4b6bbe129f4b7327cdf3 Jun 24 10:02:19.830971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Name: tempest-DeleteServersTestJSON-1227082699 Jun 24 10:02:19.830971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Role: reader,member Jun 24 10:02:19.830971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Roles: reader,member Jun 24 10:02:19.832499 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6e8e5400d9ee4b6bbe129f4b7327cdf3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6e8e5400d9ee4b6bbe129f4b7327cdf3", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6e8e5400d9ee4b6bbe129f4b7327cdf3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6e8e5400d9ee4b6bbe129f4b7327cdf3"}]}] Jun 24 10:02:19.832499 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant: tempest-DeleteServersTestJSON-1227082699 Jun 24 10:02:19.832499 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Id: 6e8e5400d9ee4b6bbe129f4b7327cdf3 Jun 24 10:02:19.832499 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Name: tempest-DeleteServersTestJSON-1227082699 Jun 24 10:02:19.832499 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User: tempest-DeleteServersTestJSON-1227082699-project Jun 24 10:02:19.832499 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Id: default Jun 24 10:02:19.832499 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Name: Default Jun 24 10:02:19.832499 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Id: 9e8b45e1b2524140bffcee941b151f24 Jun 24 10:02:19.832499 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Name: tempest-DeleteServersTestJSON-1227082699-project Jun 24 10:02:19.832499 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: method: > Jun 24 10:02:19.832499 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: exception: Instance ffd6d45e-4648-4b13-acb5-3473bf9e935a could not be found. Jun 24 10:02:19.832499 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: action_args: {'id': 'ffd6d45e-4648-4b13-acb5-3473bf9e935a'} Jun 24 10:02:19.833441 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:02:19.833441 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:02:19.833441 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:02:19.833441 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:02:19.833441 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:02:19.833441 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:02:19.833441 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:02:19.833441 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:02:19.833441 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:02:19.833441 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:02:19.833441 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffd6d45e-4648-4b13-acb5-3473bf9e935a could not be found. Jun 24 10:02:19.833441 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:02:19.833441 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:02:19.833441 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:02:19.833441 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:02:19.833441 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:02:19.833441 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:02:19.833441 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:02:19.833441 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:02:19.833441 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:02:19.834786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:02:19.834786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:02:19.834786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:02:19.834786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:02:19.834786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:02:19.834786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:02:19.834786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:02:19.834786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffd6d45e-4648-4b13-acb5-3473bf9e935a could not be found. Jun 24 10:02:19.834786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:02:19.834786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:02:19.834786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:02:19.834786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:02:19.834786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:02:19.834786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:02:19.834786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:02:19.834786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:02:19.834786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffd6d45e-4648-4b13-acb5-3473bf9e935a could not be found. Jun 24 10:02:19.834786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:02:19.835988 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-a17c609c-3d12-4df0-a5f9-62a85e69a305 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] Returning 404 to user: Instance ffd6d45e-4648-4b13-acb5-3473bf9e935a could not be found. {{(pid=124980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:02:19.835988 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-a17c609c-3d12-4df0-a5f9-62a85e69a305 tempest-DeleteServersTestJSON-1227082699 tempest-DeleteServersTestJSON-1227082699-project] 10.222.0.26 "GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a" status: 404 len: 111 microversion: 2.1 time: 0.033580 Jun 24 10:02:19.836922 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 102/216] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:19 2022] GET /compute/v2.1/servers/ffd6d45e-4648-4b13-acb5-3473bf9e935a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:02:20.154780 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-fbde0a7e-f3b6-4f68-9058-913422e51e4a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:20.156029 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-fbde0a7e-f3b6-4f68-9058-913422e51e4a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:20.162808 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fbde0a7e-f3b6-4f68-9058-913422e51e4a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:20.167504 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fbde0a7e-f3b6-4f68-9058-913422e51e4a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:20.167504 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fbde0a7e-f3b6-4f68-9058-913422e51e4a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:20.167504 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fbde0a7e-f3b6-4f68-9058-913422e51e4a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:20.307958 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-fbde0a7e-f3b6-4f68-9058-913422e51e4a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:20.315776 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-fbde0a7e-f3b6-4f68-9058-913422e51e4a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1521 microversion: 2.1 time: 0.165184 Jun 24 10:02:20.316371 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 115/217] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:20 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:21.332517 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-06ad9f81-ce63-450d-975a-1fb2010f5852 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:21.333813 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-06ad9f81-ce63-450d-975a-1fb2010f5852 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:21.340194 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-06ad9f81-ce63-450d-975a-1fb2010f5852 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:21.340725 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-06ad9f81-ce63-450d-975a-1fb2010f5852 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:21.342855 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-06ad9f81-ce63-450d-975a-1fb2010f5852 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:21.342855 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-06ad9f81-ce63-450d-975a-1fb2010f5852 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:21.540245 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-06ad9f81-ce63-450d-975a-1fb2010f5852 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:21.547889 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-06ad9f81-ce63-450d-975a-1fb2010f5852 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1521 microversion: 2.1 time: 0.219406 Jun 24 10:02:21.548480 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 103/218] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:21 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:22.565523 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-3f0b4cd9-2867-4f87-beb0-d9a3df819c58 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:22.566135 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-3f0b4cd9-2867-4f87-beb0-d9a3df819c58 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:22.573571 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3f0b4cd9-2867-4f87-beb0-d9a3df819c58 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:22.574023 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3f0b4cd9-2867-4f87-beb0-d9a3df819c58 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:22.574788 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3f0b4cd9-2867-4f87-beb0-d9a3df819c58 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:22.575221 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3f0b4cd9-2867-4f87-beb0-d9a3df819c58 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:22.712295 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-3f0b4cd9-2867-4f87-beb0-d9a3df819c58 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:22.720380 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-3f0b4cd9-2867-4f87-beb0-d9a3df819c58 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1521 microversion: 2.1 time: 0.158788 Jun 24 10:02:22.720943 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 116/219] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:22 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:02:23.736960 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-20eaa873-6657-4623-aff2-dc489b346264 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:23.737575 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-20eaa873-6657-4623-aff2-dc489b346264 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:23.743975 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-20eaa873-6657-4623-aff2-dc489b346264 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:23.744515 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-20eaa873-6657-4623-aff2-dc489b346264 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:23.749535 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-20eaa873-6657-4623-aff2-dc489b346264 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:23.749535 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-20eaa873-6657-4623-aff2-dc489b346264 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:24.001359 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-20eaa873-6657-4623-aff2-dc489b346264 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:24.035072 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-20eaa873-6657-4623-aff2-dc489b346264 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1521 microversion: 2.1 time: 0.301809 Jun 24 10:02:24.036872 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 104/220] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:23 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:25.053729 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-8f19283d-2dcd-40c3-95f2-a3256d44f7ca tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:25.054336 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-8f19283d-2dcd-40c3-95f2-a3256d44f7ca tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:25.060746 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8f19283d-2dcd-40c3-95f2-a3256d44f7ca tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:25.061189 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8f19283d-2dcd-40c3-95f2-a3256d44f7ca tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:25.061937 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8f19283d-2dcd-40c3-95f2-a3256d44f7ca tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:25.062387 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8f19283d-2dcd-40c3-95f2-a3256d44f7ca tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:25.323459 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-8f19283d-2dcd-40c3-95f2-a3256d44f7ca tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:25.333143 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-8f19283d-2dcd-40c3-95f2-a3256d44f7ca tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1521 microversion: 2.1 time: 0.282643 Jun 24 10:02:25.333714 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 117/221] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:25 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:26.350594 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-e79affad-2476-4ba3-a1f1-1ae207dbea35 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:26.351176 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-e79affad-2476-4ba3-a1f1-1ae207dbea35 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:26.357512 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e79affad-2476-4ba3-a1f1-1ae207dbea35 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:26.357967 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e79affad-2476-4ba3-a1f1-1ae207dbea35 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:26.358738 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e79affad-2476-4ba3-a1f1-1ae207dbea35 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:26.359178 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e79affad-2476-4ba3-a1f1-1ae207dbea35 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:26.499920 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-e79affad-2476-4ba3-a1f1-1ae207dbea35 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:26.507536 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-e79affad-2476-4ba3-a1f1-1ae207dbea35 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1521 microversion: 2.1 time: 0.161458 Jun 24 10:02:26.508101 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 105/222] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:26 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:27.524518 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-9d477587-400e-4c98-a19e-54976690715e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:27.525187 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-9d477587-400e-4c98-a19e-54976690715e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:27.531296 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9d477587-400e-4c98-a19e-54976690715e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:27.531746 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9d477587-400e-4c98-a19e-54976690715e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:27.532553 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9d477587-400e-4c98-a19e-54976690715e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:27.532975 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9d477587-400e-4c98-a19e-54976690715e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:27.668045 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-9d477587-400e-4c98-a19e-54976690715e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:27.675556 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-9d477587-400e-4c98-a19e-54976690715e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1521 microversion: 2.1 time: 0.154780 Jun 24 10:02:27.676135 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 118/223] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:27 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:28.698533 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-93551a19-7ec8-4712-9131-98f3976c9810 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:28.699671 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-93551a19-7ec8-4712-9131-98f3976c9810 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:28.710426 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-93551a19-7ec8-4712-9131-98f3976c9810 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:28.711240 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-93551a19-7ec8-4712-9131-98f3976c9810 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:28.712680 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-93551a19-7ec8-4712-9131-98f3976c9810 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:28.713484 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-93551a19-7ec8-4712-9131-98f3976c9810 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:28.927215 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-93551a19-7ec8-4712-9131-98f3976c9810 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:28.934744 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-93551a19-7ec8-4712-9131-98f3976c9810 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1521 microversion: 2.1 time: 0.244388 Jun 24 10:02:28.935413 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 106/224] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:28 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:29.951922 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-a1b90f48-0f70-45c7-95d9-5dca991d6cf2 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:29.952962 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-a1b90f48-0f70-45c7-95d9-5dca991d6cf2 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:29.959704 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a1b90f48-0f70-45c7-95d9-5dca991d6cf2 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:29.960178 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a1b90f48-0f70-45c7-95d9-5dca991d6cf2 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:29.960951 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a1b90f48-0f70-45c7-95d9-5dca991d6cf2 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:29.961385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a1b90f48-0f70-45c7-95d9-5dca991d6cf2 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:30.099505 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-a1b90f48-0f70-45c7-95d9-5dca991d6cf2 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:30.107611 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-a1b90f48-0f70-45c7-95d9-5dca991d6cf2 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1521 microversion: 2.1 time: 0.160177 Jun 24 10:02:30.108164 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 119/225] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:29 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:31.125053 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-6b840df9-18f4-4a3a-a2dd-dd2d633307ff tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:31.125800 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-6b840df9-18f4-4a3a-a2dd-dd2d633307ff tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:31.131951 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6b840df9-18f4-4a3a-a2dd-dd2d633307ff tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:31.133067 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6b840df9-18f4-4a3a-a2dd-dd2d633307ff tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:31.133829 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6b840df9-18f4-4a3a-a2dd-dd2d633307ff tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:31.134261 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6b840df9-18f4-4a3a-a2dd-dd2d633307ff tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:31.282986 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-6b840df9-18f4-4a3a-a2dd-dd2d633307ff tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:31.294328 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-6b840df9-18f4-4a3a-a2dd-dd2d633307ff tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1521 microversion: 2.1 time: 0.172563 Jun 24 10:02:31.295556 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 107/226] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:31 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:32.313433 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-8f7bdd2e-c209-403f-8490-f0f163f61e5b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:32.313973 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-8f7bdd2e-c209-403f-8490-f0f163f61e5b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:32.322145 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8f7bdd2e-c209-403f-8490-f0f163f61e5b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:32.322607 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8f7bdd2e-c209-403f-8490-f0f163f61e5b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:32.323541 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8f7bdd2e-c209-403f-8490-f0f163f61e5b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:32.323912 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8f7bdd2e-c209-403f-8490-f0f163f61e5b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:32.485171 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-8f7bdd2e-c209-403f-8490-f0f163f61e5b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:32.496488 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-8f7bdd2e-c209-403f-8490-f0f163f61e5b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1521 microversion: 2.1 time: 0.186327 Jun 24 10:02:32.496488 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 120/227] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:32 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:33.512846 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-8ea8b046-5a62-4a00-8367-1c857c305e24 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:33.513534 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-8ea8b046-5a62-4a00-8367-1c857c305e24 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:33.520370 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8ea8b046-5a62-4a00-8367-1c857c305e24 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:33.520819 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8ea8b046-5a62-4a00-8367-1c857c305e24 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:33.521575 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8ea8b046-5a62-4a00-8367-1c857c305e24 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:33.522007 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8ea8b046-5a62-4a00-8367-1c857c305e24 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:33.705541 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-8ea8b046-5a62-4a00-8367-1c857c305e24 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:33.714298 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-8ea8b046-5a62-4a00-8367-1c857c305e24 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1501 microversion: 2.1 time: 0.205208 Jun 24 10:02:33.714855 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 108/228] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:33 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1501 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:33.731849 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-325678c8-b07f-4783-86a2-db5889524053 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:33.733014 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-325678c8-b07f-4783-86a2-db5889524053 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:33.740223 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-325678c8-b07f-4783-86a2-db5889524053 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:33.740829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-325678c8-b07f-4783-86a2-db5889524053 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:33.741775 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-325678c8-b07f-4783-86a2-db5889524053 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:33.742477 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-325678c8-b07f-4783-86a2-db5889524053 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:33.896863 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-325678c8-b07f-4783-86a2-db5889524053 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:33.906499 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-325678c8-b07f-4783-86a2-db5889524053 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1514 microversion: 2.1 time: 0.179163 Jun 24 10:02:33.916107 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 121/229] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:33 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:35.954966 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-9ca76d7a-396b-4bc0-b212-9fa67018afda tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:02:35.956563 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-9ca76d7a-396b-4bc0-b212-9fa67018afda tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:35.962887 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:02:35.964845 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9ca76d7a-396b-4bc0-b212-9fa67018afda tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:35.965525 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9ca76d7a-396b-4bc0-b212-9fa67018afda tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:35.966503 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9ca76d7a-396b-4bc0-b212-9fa67018afda tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:35.967127 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9ca76d7a-396b-4bc0-b212-9fa67018afda tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:35.992885 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.objects.instance [None req-9ca76d7a-396b-4bc0-b212-9fa67018afda tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lazy-loading 'flavor' on Instance uuid ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 {{(pid=124980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:02:36.347177 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-9ca76d7a-396b-4bc0-b212-9fa67018afda tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "POST /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6/action" status: 200 len: 32 microversion: 2.1 time: 0.396365 Jun 24 10:02:36.347786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 109/230] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Jun 24 10:02:35 2022] POST /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6/action => generated 32 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 10:02:36.357362 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-4efec65d-6493-4846-814a-31a03eec778b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:36.357967 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-4efec65d-6493-4846-814a-31a03eec778b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:36.364625 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4efec65d-6493-4846-814a-31a03eec778b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:36.365071 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4efec65d-6493-4846-814a-31a03eec778b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:36.365830 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4efec65d-6493-4846-814a-31a03eec778b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:36.366283 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4efec65d-6493-4846-814a-31a03eec778b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:36.494475 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-4efec65d-6493-4846-814a-31a03eec778b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:36.501942 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-4efec65d-6493-4846-814a-31a03eec778b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1520 microversion: 2.1 time: 0.148398 Jun 24 10:02:36.502490 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 122/231] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:36 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:37.519752 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-6a5bee63-4924-481a-8eb3-f767406a3e24 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:37.520514 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-6a5bee63-4924-481a-8eb3-f767406a3e24 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:37.527472 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6a5bee63-4924-481a-8eb3-f767406a3e24 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:37.527869 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6a5bee63-4924-481a-8eb3-f767406a3e24 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:37.528660 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6a5bee63-4924-481a-8eb3-f767406a3e24 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:37.529103 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6a5bee63-4924-481a-8eb3-f767406a3e24 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:37.547479 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:02:37.663860 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-6a5bee63-4924-481a-8eb3-f767406a3e24 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:37.671823 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-6a5bee63-4924-481a-8eb3-f767406a3e24 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1520 microversion: 2.1 time: 0.156756 Jun 24 10:02:37.672513 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 110/232] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:37 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:02:38.690927 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-63e5dfbf-d151-406a-b5f5-ebd7cb902385 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:38.699366 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-63e5dfbf-d151-406a-b5f5-ebd7cb902385 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:38.709739 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_api:SELECT=38 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:02:38.713080 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-63e5dfbf-d151-406a-b5f5-ebd7cb902385 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:38.717701 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-63e5dfbf-d151-406a-b5f5-ebd7cb902385 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:38.718612 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-63e5dfbf-d151-406a-b5f5-ebd7cb902385 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:38.719362 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-63e5dfbf-d151-406a-b5f5-ebd7cb902385 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:38.877225 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=100 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:02:38.995916 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-63e5dfbf-d151-406a-b5f5-ebd7cb902385 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:39.003289 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-63e5dfbf-d151-406a-b5f5-ebd7cb902385 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1520 microversion: 2.1 time: 0.317506 Jun 24 10:02:39.003839 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 123/233] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:38 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1520 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:40.021222 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-2586aec4-5fbe-4a9f-98b7-eea1db80121b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:40.021963 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-2586aec4-5fbe-4a9f-98b7-eea1db80121b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:40.028556 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2586aec4-5fbe-4a9f-98b7-eea1db80121b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:40.029003 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2586aec4-5fbe-4a9f-98b7-eea1db80121b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:40.029766 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2586aec4-5fbe-4a9f-98b7-eea1db80121b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:40.035586 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2586aec4-5fbe-4a9f-98b7-eea1db80121b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:40.181363 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2586aec4-5fbe-4a9f-98b7-eea1db80121b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:40.188723 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-2586aec4-5fbe-4a9f-98b7-eea1db80121b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1520 microversion: 2.1 time: 0.171934 Jun 24 10:02:40.189287 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 111/234] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:40 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:41.205583 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-6a389b98-9639-430d-86ef-a5c77e9ee757 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:41.206181 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-6a389b98-9639-430d-86ef-a5c77e9ee757 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:41.213577 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6a389b98-9639-430d-86ef-a5c77e9ee757 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:41.214042 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6a389b98-9639-430d-86ef-a5c77e9ee757 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:41.214803 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6a389b98-9639-430d-86ef-a5c77e9ee757 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:41.215231 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6a389b98-9639-430d-86ef-a5c77e9ee757 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:41.342591 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-6a389b98-9639-430d-86ef-a5c77e9ee757 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:41.350082 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-6a389b98-9639-430d-86ef-a5c77e9ee757 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1520 microversion: 2.1 time: 0.148653 Jun 24 10:02:41.350649 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 124/235] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:41 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:42.367076 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-8c63ddbe-a6b7-4578-8943-e9b31ce8302b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:42.369087 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-8c63ddbe-a6b7-4578-8943-e9b31ce8302b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:42.375326 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8c63ddbe-a6b7-4578-8943-e9b31ce8302b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:42.375779 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8c63ddbe-a6b7-4578-8943-e9b31ce8302b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:42.376567 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8c63ddbe-a6b7-4578-8943-e9b31ce8302b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:42.376996 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8c63ddbe-a6b7-4578-8943-e9b31ce8302b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:42.503776 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-8c63ddbe-a6b7-4578-8943-e9b31ce8302b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:42.511649 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-8c63ddbe-a6b7-4578-8943-e9b31ce8302b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1520 microversion: 2.1 time: 0.148735 Jun 24 10:02:42.512242 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 112/236] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:42 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:43.528598 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-5d81b1e8-ba68-4a2f-8e5e-5a5aafb379cd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:43.529143 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-5d81b1e8-ba68-4a2f-8e5e-5a5aafb379cd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:43.535602 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5d81b1e8-ba68-4a2f-8e5e-5a5aafb379cd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:43.536052 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5d81b1e8-ba68-4a2f-8e5e-5a5aafb379cd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:43.536845 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5d81b1e8-ba68-4a2f-8e5e-5a5aafb379cd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:43.537330 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5d81b1e8-ba68-4a2f-8e5e-5a5aafb379cd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:43.666936 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-5d81b1e8-ba68-4a2f-8e5e-5a5aafb379cd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:43.674326 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-5d81b1e8-ba68-4a2f-8e5e-5a5aafb379cd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1520 microversion: 2.1 time: 0.149797 Jun 24 10:02:43.674883 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 125/237] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:43 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:44.691342 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-be47331f-1cf4-416f-9c7e-4b23b6c9cdaf tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:44.691954 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-be47331f-1cf4-416f-9c7e-4b23b6c9cdaf tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:44.698386 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-be47331f-1cf4-416f-9c7e-4b23b6c9cdaf tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:44.698841 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-be47331f-1cf4-416f-9c7e-4b23b6c9cdaf tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:44.699604 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-be47331f-1cf4-416f-9c7e-4b23b6c9cdaf tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:44.700109 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-be47331f-1cf4-416f-9c7e-4b23b6c9cdaf tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:44.837457 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-be47331f-1cf4-416f-9c7e-4b23b6c9cdaf tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:44.842544 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-be47331f-1cf4-416f-9c7e-4b23b6c9cdaf tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1520 microversion: 2.1 time: 0.155040 Jun 24 10:02:44.843098 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 113/238] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:44 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:45.860598 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-ec59d5be-04b9-4fcc-b8ab-5c1d93ea1bff tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:45.861605 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-ec59d5be-04b9-4fcc-b8ab-5c1d93ea1bff tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:45.868651 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ec59d5be-04b9-4fcc-b8ab-5c1d93ea1bff tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:45.869105 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ec59d5be-04b9-4fcc-b8ab-5c1d93ea1bff tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:45.869869 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ec59d5be-04b9-4fcc-b8ab-5c1d93ea1bff tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:45.870323 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ec59d5be-04b9-4fcc-b8ab-5c1d93ea1bff tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:45.998286 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-ec59d5be-04b9-4fcc-b8ab-5c1d93ea1bff tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:46.005820 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-ec59d5be-04b9-4fcc-b8ab-5c1d93ea1bff tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1520 microversion: 2.1 time: 0.149624 Jun 24 10:02:46.006390 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 126/239] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:45 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:46.153048 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-f424ed2f-ecaa-4292-b72b-88e96ea69eea tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-492362940", "imageRef": "f6b1dddb-2953-41a2-99e3-00aeca441bd9", "flavorRef": "452", "networks": [{"uuid": "5a7bb7ca-64c1-4f04-8b5a-a9887aea00fc"}]}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:02:46.204151 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.network.neutron [None req-f424ed2f-ecaa-4292-b72b-88e96ea69eea tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] validate_networks() for [('5a7bb7ca-64c1-4f04-8b5a-a9887aea00fc', None, None, None, None, None)] {{(pid=124980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:02:46.553776 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-f424ed2f-ecaa-4292-b72b-88e96ea69eea tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Flavor limits 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:02:46.554234 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-f424ed2f-ecaa-4292-b72b-88e96ea69eea tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Image limits 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:02:46.554738 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-f424ed2f-ecaa-4292-b72b-88e96ea69eea tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Flavor pref 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:02:46.555180 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-f424ed2f-ecaa-4292-b72b-88e96ea69eea tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Image pref 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:02:46.555593 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-f424ed2f-ecaa-4292-b72b-88e96ea69eea tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:02:46.564416 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f424ed2f-ecaa-4292-b72b-88e96ea69eea tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:46.564865 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f424ed2f-ecaa-4292-b72b-88e96ea69eea tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:46.565663 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f424ed2f-ecaa-4292-b72b-88e96ea69eea tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:46.566099 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f424ed2f-ecaa-4292-b72b-88e96ea69eea tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:46.583330 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-f424ed2f-ecaa-4292-b72b-88e96ea69eea tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Getting quotas for project f896de1750fe4c7d9eef897027efb42f. Resources: {'instances', 'cores', 'ram'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:02:46.587784 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-f424ed2f-ecaa-4292-b72b-88e96ea69eea tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Getting quotas for user ff0cf4a0b4e04ce79340bac70992bf32 and project f896de1750fe4c7d9eef897027efb42f. Resources: {'instances', 'cores', 'ram'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:02:46.599239 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-f424ed2f-ecaa-4292-b72b-88e96ea69eea tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Going to run 1 instances... {{(pid=124980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:02:46.601501 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-f424ed2f-ecaa-4292-b72b-88e96ea69eea tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6b1dddb-2953-41a2-99e3-00aeca441bd9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:02:46.721010 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-f424ed2f-ecaa-4292-b72b-88e96ea69eea tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571736 Jun 24 10:02:46.721655 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 114/240] 10.222.0.26 () {60 vars in 1146 bytes} [Fri Jun 24 10:02:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:02:46.732061 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-413da484-13ac-4564-b122-05e3e9399ddf tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:46.737998 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-413da484-13ac-4564-b122-05e3e9399ddf tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:46.790534 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-413da484-13ac-4564-b122-05e3e9399ddf tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:46.797841 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-413da484-13ac-4564-b122-05e3e9399ddf tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1213 microversion: 2.1 time: 0.069644 Jun 24 10:02:46.798780 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 127/241] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:46 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:47.022828 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-3d203c6c-8baf-442d-8c2f-0c407eda13b2 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:47.024032 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-3d203c6c-8baf-442d-8c2f-0c407eda13b2 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:47.030293 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3d203c6c-8baf-442d-8c2f-0c407eda13b2 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:47.032041 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3d203c6c-8baf-442d-8c2f-0c407eda13b2 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:47.032041 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3d203c6c-8baf-442d-8c2f-0c407eda13b2 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:47.032041 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3d203c6c-8baf-442d-8c2f-0c407eda13b2 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:47.166500 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-3d203c6c-8baf-442d-8c2f-0c407eda13b2 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:47.174988 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-3d203c6c-8baf-442d-8c2f-0c407eda13b2 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1520 microversion: 2.1 time: 0.156045 Jun 24 10:02:47.183133 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 115/242] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:47 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:47.815736 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-6b18e0b1-c158-4c7c-ab67-18375bcae685 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:47.816997 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-6b18e0b1-c158-4c7c-ab67-18375bcae685 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:47.875367 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-6b18e0b1-c158-4c7c-ab67-18375bcae685 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:47.882743 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-6b18e0b1-c158-4c7c-ab67-18375bcae685 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1213 microversion: 2.1 time: 0.071677 Jun 24 10:02:47.883296 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 128/243] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:47 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:48.192597 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-18a52a48-a92b-43aa-af84-f03538b97918 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:48.193200 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-18a52a48-a92b-43aa-af84-f03538b97918 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:48.199328 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-18a52a48-a92b-43aa-af84-f03538b97918 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:48.199770 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-18a52a48-a92b-43aa-af84-f03538b97918 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:48.200603 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-18a52a48-a92b-43aa-af84-f03538b97918 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:48.201032 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-18a52a48-a92b-43aa-af84-f03538b97918 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:48.331548 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-18a52a48-a92b-43aa-af84-f03538b97918 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:48.338998 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-18a52a48-a92b-43aa-af84-f03538b97918 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1520 microversion: 2.1 time: 0.150313 Jun 24 10:02:48.339563 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 116/244] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:48 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:48.898568 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-728b8647-41ce-43f0-a01b-b12769824a0b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:48.899184 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-728b8647-41ce-43f0-a01b-b12769824a0b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:48.905706 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-728b8647-41ce-43f0-a01b-b12769824a0b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:48.906160 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-728b8647-41ce-43f0-a01b-b12769824a0b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:48.906920 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-728b8647-41ce-43f0-a01b-b12769824a0b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:48.907359 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-728b8647-41ce-43f0-a01b-b12769824a0b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:48.970259 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-728b8647-41ce-43f0-a01b-b12769824a0b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:48.978216 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-728b8647-41ce-43f0-a01b-b12769824a0b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1217 microversion: 2.1 time: 0.083443 Jun 24 10:02:48.978782 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 129/245] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:48 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:49.355882 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-97f63ca1-59d5-4ae9-961b-b26876b66766 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:49.356559 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-97f63ca1-59d5-4ae9-961b-b26876b66766 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:49.362856 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-97f63ca1-59d5-4ae9-961b-b26876b66766 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:49.363330 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-97f63ca1-59d5-4ae9-961b-b26876b66766 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:49.364095 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-97f63ca1-59d5-4ae9-961b-b26876b66766 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:49.364562 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-97f63ca1-59d5-4ae9-961b-b26876b66766 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:49.492177 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-97f63ca1-59d5-4ae9-961b-b26876b66766 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:49.499507 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-97f63ca1-59d5-4ae9-961b-b26876b66766 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1520 microversion: 2.1 time: 0.148140 Jun 24 10:02:49.500061 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 117/246] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:49 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:49.995679 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-cded597a-13d4-4b0b-b9b9-ce8a85d4d0fd tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:49.996233 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-cded597a-13d4-4b0b-b9b9-ce8a85d4d0fd tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:50.003076 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-cded597a-13d4-4b0b-b9b9-ce8a85d4d0fd tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:50.003533 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-cded597a-13d4-4b0b-b9b9-ce8a85d4d0fd tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:50.004560 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-cded597a-13d4-4b0b-b9b9-ce8a85d4d0fd tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:50.005007 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-cded597a-13d4-4b0b-b9b9-ce8a85d4d0fd tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:50.073781 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-cded597a-13d4-4b0b-b9b9-ce8a85d4d0fd tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:50.081217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-cded597a-13d4-4b0b-b9b9-ce8a85d4d0fd tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1217 microversion: 2.1 time: 0.090265 Jun 24 10:02:50.081777 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 130/247] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:49 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:50.516261 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-3c4203c9-6726-4d13-92b7-e6c96a9a75d4 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:50.516868 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-3c4203c9-6726-4d13-92b7-e6c96a9a75d4 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:50.522873 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3c4203c9-6726-4d13-92b7-e6c96a9a75d4 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:50.524540 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3c4203c9-6726-4d13-92b7-e6c96a9a75d4 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:50.524540 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3c4203c9-6726-4d13-92b7-e6c96a9a75d4 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:50.524744 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3c4203c9-6726-4d13-92b7-e6c96a9a75d4 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:50.652440 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-3c4203c9-6726-4d13-92b7-e6c96a9a75d4 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:50.660046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-3c4203c9-6726-4d13-92b7-e6c96a9a75d4 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1520 microversion: 2.1 time: 0.147499 Jun 24 10:02:50.660669 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 118/248] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:50 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:51.098101 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-3d8c05e7-b282-4662-a276-5ca86f53f9cc tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:51.098708 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-3d8c05e7-b282-4662-a276-5ca86f53f9cc tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:51.105826 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3d8c05e7-b282-4662-a276-5ca86f53f9cc tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:51.106273 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3d8c05e7-b282-4662-a276-5ca86f53f9cc tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:51.107032 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3d8c05e7-b282-4662-a276-5ca86f53f9cc tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:51.107470 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3d8c05e7-b282-4662-a276-5ca86f53f9cc tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:51.168730 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-3d8c05e7-b282-4662-a276-5ca86f53f9cc tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:51.176210 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-3d8c05e7-b282-4662-a276-5ca86f53f9cc tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1265 microversion: 2.1 time: 0.081997 Jun 24 10:02:51.176769 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 131/249] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:51 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:51.677592 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-e2f17a24-52fe-4398-94a0-36770b588497 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:51.678205 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-e2f17a24-52fe-4398-94a0-36770b588497 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:51.684734 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e2f17a24-52fe-4398-94a0-36770b588497 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:51.685184 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e2f17a24-52fe-4398-94a0-36770b588497 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:51.685942 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e2f17a24-52fe-4398-94a0-36770b588497 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:51.686379 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e2f17a24-52fe-4398-94a0-36770b588497 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:51.819354 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-e2f17a24-52fe-4398-94a0-36770b588497 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:51.827553 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-e2f17a24-52fe-4398-94a0-36770b588497 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1520 microversion: 2.1 time: 0.153783 Jun 24 10:02:51.828136 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 119/250] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:51 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:52.193041 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-6fa0dd2e-8161-436c-8948-b3a6523ed0e4 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:52.193656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-6fa0dd2e-8161-436c-8948-b3a6523ed0e4 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:52.200196 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6fa0dd2e-8161-436c-8948-b3a6523ed0e4 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:52.200644 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6fa0dd2e-8161-436c-8948-b3a6523ed0e4 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:52.201401 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6fa0dd2e-8161-436c-8948-b3a6523ed0e4 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:52.201845 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6fa0dd2e-8161-436c-8948-b3a6523ed0e4 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:52.264667 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-6fa0dd2e-8161-436c-8948-b3a6523ed0e4 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:52.272013 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-6fa0dd2e-8161-436c-8948-b3a6523ed0e4 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1265 microversion: 2.1 time: 0.082791 Jun 24 10:02:52.272613 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 132/251] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:52 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:02:52.844648 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-ff982f9d-e636-45e5-8fa1-5f2222c979ad tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:52.845279 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-ff982f9d-e636-45e5-8fa1-5f2222c979ad tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:52.851147 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ff982f9d-e636-45e5-8fa1-5f2222c979ad tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:52.851633 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ff982f9d-e636-45e5-8fa1-5f2222c979ad tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:52.852428 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ff982f9d-e636-45e5-8fa1-5f2222c979ad tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:52.852869 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ff982f9d-e636-45e5-8fa1-5f2222c979ad tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:52.980268 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-ff982f9d-e636-45e5-8fa1-5f2222c979ad tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:52.987674 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-ff982f9d-e636-45e5-8fa1-5f2222c979ad tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1520 microversion: 2.1 time: 0.146898 Jun 24 10:02:52.988262 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 120/252] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:52 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:53.289515 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-e55b1e84-6a65-4151-8a95-e2646b7c6d9b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:53.290047 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-e55b1e84-6a65-4151-8a95-e2646b7c6d9b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:53.296813 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e55b1e84-6a65-4151-8a95-e2646b7c6d9b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:53.297267 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e55b1e84-6a65-4151-8a95-e2646b7c6d9b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:53.298028 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e55b1e84-6a65-4151-8a95-e2646b7c6d9b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:53.298466 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e55b1e84-6a65-4151-8a95-e2646b7c6d9b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:53.357739 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-e55b1e84-6a65-4151-8a95-e2646b7c6d9b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:53.365189 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-e55b1e84-6a65-4151-8a95-e2646b7c6d9b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1265 microversion: 2.1 time: 0.079584 Jun 24 10:02:53.365754 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 133/253] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:53 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1265 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:54.004785 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-9226430c-ae3e-4500-b7db-d87bcd31410e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:54.005399 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-9226430c-ae3e-4500-b7db-d87bcd31410e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:54.011867 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9226430c-ae3e-4500-b7db-d87bcd31410e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:54.012360 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9226430c-ae3e-4500-b7db-d87bcd31410e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:54.013119 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9226430c-ae3e-4500-b7db-d87bcd31410e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:54.013552 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9226430c-ae3e-4500-b7db-d87bcd31410e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:54.150210 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-9226430c-ae3e-4500-b7db-d87bcd31410e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:54.158475 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-9226430c-ae3e-4500-b7db-d87bcd31410e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1520 microversion: 2.1 time: 0.157362 Jun 24 10:02:54.159172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 121/254] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:53 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:54.382391 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-f1d49c7b-1f41-4a57-ab4f-d730e01da9ee tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:54.382930 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-f1d49c7b-1f41-4a57-ab4f-d730e01da9ee tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:54.389601 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f1d49c7b-1f41-4a57-ab4f-d730e01da9ee tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:54.392925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f1d49c7b-1f41-4a57-ab4f-d730e01da9ee tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:54.392925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f1d49c7b-1f41-4a57-ab4f-d730e01da9ee tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:54.392925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f1d49c7b-1f41-4a57-ab4f-d730e01da9ee tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:54.451181 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-f1d49c7b-1f41-4a57-ab4f-d730e01da9ee tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:54.458564 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-f1d49c7b-1f41-4a57-ab4f-d730e01da9ee tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1273 microversion: 2.1 time: 0.080183 Jun 24 10:02:54.459125 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 134/255] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:54 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1273 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:55.179175 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-b5711440-ecbd-4b3f-9dd0-e5e4341db369 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:55.179851 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-b5711440-ecbd-4b3f-9dd0-e5e4341db369 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:55.186283 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b5711440-ecbd-4b3f-9dd0-e5e4341db369 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:55.186734 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b5711440-ecbd-4b3f-9dd0-e5e4341db369 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:55.187508 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b5711440-ecbd-4b3f-9dd0-e5e4341db369 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:55.187944 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b5711440-ecbd-4b3f-9dd0-e5e4341db369 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:55.319437 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-b5711440-ecbd-4b3f-9dd0-e5e4341db369 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:55.327867 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-b5711440-ecbd-4b3f-9dd0-e5e4341db369 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1520 microversion: 2.1 time: 0.152983 Jun 24 10:02:55.328499 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 122/256] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:55 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:55.474983 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-8ddd0289-432b-4999-9f08-496c10a8a623 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:55.475617 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-8ddd0289-432b-4999-9f08-496c10a8a623 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:55.482273 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8ddd0289-432b-4999-9f08-496c10a8a623 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:55.482732 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8ddd0289-432b-4999-9f08-496c10a8a623 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:55.483508 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8ddd0289-432b-4999-9f08-496c10a8a623 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:55.483957 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8ddd0289-432b-4999-9f08-496c10a8a623 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:55.548682 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-8ddd0289-432b-4999-9f08-496c10a8a623 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:55.562528 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-8ddd0289-432b-4999-9f08-496c10a8a623 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1273 microversion: 2.1 time: 0.091517 Jun 24 10:02:55.563105 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 135/257] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:55 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:56.345181 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-470a356d-48c8-4d23-b686-2b8f5900a710 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:56.345833 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-470a356d-48c8-4d23-b686-2b8f5900a710 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:56.352916 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-470a356d-48c8-4d23-b686-2b8f5900a710 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:56.353597 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-470a356d-48c8-4d23-b686-2b8f5900a710 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:56.354604 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-470a356d-48c8-4d23-b686-2b8f5900a710 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:56.355209 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-470a356d-48c8-4d23-b686-2b8f5900a710 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:56.574068 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell0:SELECT=2 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:02:56.579443 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-470a356d-48c8-4d23-b686-2b8f5900a710 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:56.580440 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-8fc51172-8468-411a-b65c-87a7f85098f8 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:56.581149 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-8fc51172-8468-411a-b65c-87a7f85098f8 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:56.587850 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-470a356d-48c8-4d23-b686-2b8f5900a710 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1520 microversion: 2.1 time: 0.246601 Jun 24 10:02:56.588277 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8fc51172-8468-411a-b65c-87a7f85098f8 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:56.588932 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8fc51172-8468-411a-b65c-87a7f85098f8 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:56.590024 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8fc51172-8468-411a-b65c-87a7f85098f8 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:56.590468 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8fc51172-8468-411a-b65c-87a7f85098f8 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:56.597496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 123/258] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:56 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:56.655687 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-8fc51172-8468-411a-b65c-87a7f85098f8 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:56.663473 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-8fc51172-8468-411a-b65c-87a7f85098f8 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1271 microversion: 2.1 time: 0.087280 Jun 24 10:02:56.664029 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 136/259] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:56 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:02:57.605112 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-409bf421-3868-45fa-9976-6fc4fc7cc81d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:57.605675 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-409bf421-3868-45fa-9976-6fc4fc7cc81d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:57.607827 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell0:SELECT=6 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:02:57.618799 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-409bf421-3868-45fa-9976-6fc4fc7cc81d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:57.619252 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-409bf421-3868-45fa-9976-6fc4fc7cc81d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:57.620032 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-409bf421-3868-45fa-9976-6fc4fc7cc81d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:57.620503 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-409bf421-3868-45fa-9976-6fc4fc7cc81d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:57.681244 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-5194eee8-1dda-4f1b-9fa1-56a90b0434ab tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:57.681869 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-5194eee8-1dda-4f1b-9fa1-56a90b0434ab tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:57.690125 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5194eee8-1dda-4f1b-9fa1-56a90b0434ab tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:57.690125 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5194eee8-1dda-4f1b-9fa1-56a90b0434ab tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:57.693789 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5194eee8-1dda-4f1b-9fa1-56a90b0434ab tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:57.694682 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5194eee8-1dda-4f1b-9fa1-56a90b0434ab tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:57.763471 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-409bf421-3868-45fa-9976-6fc4fc7cc81d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:57.771382 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-409bf421-3868-45fa-9976-6fc4fc7cc81d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1520 microversion: 2.1 time: 0.170770 Jun 24 10:02:57.781499 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 124/260] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:57 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:57.837158 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-5194eee8-1dda-4f1b-9fa1-56a90b0434ab tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:57.843150 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-5194eee8-1dda-4f1b-9fa1-56a90b0434ab tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1313 microversion: 2.1 time: 0.166425 Jun 24 10:02:57.843706 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 137/261] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:57 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:02:58.789097 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-fa45b8a5-1dea-4bbf-87bc-b8155f183a9d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:58.789682 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-fa45b8a5-1dea-4bbf-87bc-b8155f183a9d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:58.796144 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-fa45b8a5-1dea-4bbf-87bc-b8155f183a9d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:58.796676 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-fa45b8a5-1dea-4bbf-87bc-b8155f183a9d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:58.797442 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-fa45b8a5-1dea-4bbf-87bc-b8155f183a9d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:58.797879 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-fa45b8a5-1dea-4bbf-87bc-b8155f183a9d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:58.860533 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-5794a49b-90ca-4de1-a0a7-5db19c4ffaa6 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:58.861254 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-5794a49b-90ca-4de1-a0a7-5db19c4ffaa6 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:58.863226 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell0:SELECT=4 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:02:58.868699 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5794a49b-90ca-4de1-a0a7-5db19c4ffaa6 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:58.869151 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5794a49b-90ca-4de1-a0a7-5db19c4ffaa6 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:58.869951 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5794a49b-90ca-4de1-a0a7-5db19c4ffaa6 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:58.870405 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5794a49b-90ca-4de1-a0a7-5db19c4ffaa6 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:58.930487 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-fa45b8a5-1dea-4bbf-87bc-b8155f183a9d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:58.938544 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-fa45b8a5-1dea-4bbf-87bc-b8155f183a9d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1500 microversion: 2.1 time: 0.153706 Jun 24 10:02:58.939115 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 125/262] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:58 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1500 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:02:58.955801 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-3ee6ecfd-9c36-4aac-960b-6cbf988efb37 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d15e4ea0-5d72-4d4f-a9dc-5da128e5a314"}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:02:58.957224 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-3ee6ecfd-9c36-4aac-960b-6cbf988efb37 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:58.963923 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3ee6ecfd-9c36-4aac-960b-6cbf988efb37 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:58.964384 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3ee6ecfd-9c36-4aac-960b-6cbf988efb37 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:58.965146 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3ee6ecfd-9c36-4aac-960b-6cbf988efb37 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:58.965577 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3ee6ecfd-9c36-4aac-960b-6cbf988efb37 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:58.988933 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.wsgi [None req-3ee6ecfd-9c36-4aac-960b-6cbf988efb37 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] HTTP exception thrown: Cannot 'attach_volume' instance ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 while it is in vm_state rescued Jun 24 10:02:58.990602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-3ee6ecfd-9c36-4aac-960b-6cbf988efb37 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Request method failure captured: Jun 24 10:02:58.990602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: request: POST /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6/os-volume_attachments HTTP/1.1 Jun 24 10:02:58.990602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept: application/json Jun 24 10:02:58.990602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept-Encoding: identity Jun 24 10:02:58.990602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Connection: close Jun 24 10:02:58.990602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Length: 74 Jun 24 10:02:58.990602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Type: application/json Jun 24 10:02:58.990602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Host: 10.222.0.26 Jun 24 10:02:58.990602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Openstack-System-Scope: None Jun 24 10:02:58.990602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: User-Agent: python-urllib3/1.26.9 Jun 24 10:02:58.990602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Auth-Token: gAAAAABitYtobSN6CjiACUjTyXEql4xKzLsglXk-l3YaDQLAZo4vs-RgMAM3IADpJhPypTRBSlCExLMR--YbzFicmjbwkbj-OJB_zzYsnZ_Gbqq5n_CnUB_ypRKgSN3BcXHuMsmCBlnf0I3kK4SJFeqnT6AupdpkZsj57O8A_owmEagvxq33osI Jun 24 10:02:58.990602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Id: None Jun 24 10:02:58.990602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Name: None Jun 24 10:02:58.990602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Identity-Status: Confirmed Jun 24 10:02:58.990602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Is-Admin-Project: True Jun 24 10:02:58.990602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Id: default Jun 24 10:02:58.990602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Name: Default Jun 24 10:02:58.990602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Id: ddf89eff2d584c508a967f1686090be1 Jun 24 10:02:58.990602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1125620466 Jun 24 10:02:58.990602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Role: reader,member Jun 24 10:02:58.990602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Roles: reader,member Jun 24 10:02:58.992183 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ddf89eff2d584c508a967f1686090be1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ddf89eff2d584c508a967f1686090be1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ddf89eff2d584c508a967f1686090be1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ddf89eff2d584c508a967f1686090be1"}]}] Jun 24 10:02:58.992183 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1125620466 Jun 24 10:02:58.992183 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Id: ddf89eff2d584c508a967f1686090be1 Jun 24 10:02:58.992183 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1125620466 Jun 24 10:02:58.992183 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User: tempest-ServerRescueNegativeTestJSON-1125620466-project Jun 24 10:02:58.992183 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Id: default Jun 24 10:02:58.992183 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Name: Default Jun 24 10:02:58.992183 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Id: b03913e742104648977aa5d61347f38e Jun 24 10:02:58.992183 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1125620466-project Jun 24 10:02:58.992183 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Jun 24 10:02:58.992183 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: {"volumeAttachment": {"volumeId": "d15e4ea0-5d72-4d4f-a9dc-5da128e5a314"}} Jun 24 10:02:58.992183 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: method: > Jun 24 10:02:58.996998 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: exception: Cannot 'attach_volume' instance ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 while it is in vm_state rescued Jun 24 10:02:58.996998 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: action_args: {'server_id': 'ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6', 'body': {'volumeAttachment': {'volumeId': 'd15e4ea0-5d72-4d4f-a9dc-5da128e5a314'}}} Jun 24 10:02:58.996998 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:02:58.996998 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:02:58.996998 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 10:02:58.996998 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 10:02:58.996998 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 10:02:58.996998 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 10:02:58.996998 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 24 10:02:58.996998 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 24 10:02:58.996998 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 24 10:02:58.996998 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:02:58.996998 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:02:58.996998 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:02:58.996998 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:02:58.996998 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:02:58.996998 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:02:58.996998 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:02:58.996998 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:02:58.998240 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:02:58.998240 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:02:58.998240 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 10:02:58.998240 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:02:58.998240 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 10:02:58.998240 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:02:58.998240 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 10:02:58.998240 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:02:58.998240 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 24 10:02:58.998240 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 24 10:02:58.998240 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 24 10:02:58.998240 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 24 10:02:58.998240 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 while it is in vm_state rescued Jun 24 10:02:58.998240 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:02:58.998240 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:02:58.998240 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:02:58.998240 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:02:58.998240 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:02:58.998240 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:02:58.999514 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:02:58.999514 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:02:58.999514 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 while it is in vm_state rescued Jun 24 10:02:58.999514 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:02:58.999514 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-3ee6ecfd-9c36-4aac-960b-6cbf988efb37 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Returning 409 to user: Cannot 'attach_volume' instance ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 while it is in vm_state rescued {{(pid=124980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:02:58.999514 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-3ee6ecfd-9c36-4aac-960b-6cbf988efb37 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "POST /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040227 Jun 24 10:02:58.999514 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 126/263] 10.222.0.26 () {60 vars in 1322 bytes} [Fri Jun 24 10:02:58 2022] POST /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 24 10:02:59.001529 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-41d26349-1fab-4195-bac5-93d9517adfec tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:02:59.002145 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-41d26349-1fab-4195-bac5-93d9517adfec tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:59.003478 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-5794a49b-90ca-4de1-a0a7-5db19c4ffaa6 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:59.009095 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-41d26349-1fab-4195-bac5-93d9517adfec tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:59.013071 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-41d26349-1fab-4195-bac5-93d9517adfec tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:59.013071 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-41d26349-1fab-4195-bac5-93d9517adfec tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:59.013071 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-41d26349-1fab-4195-bac5-93d9517adfec tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:59.013343 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-5794a49b-90ca-4de1-a0a7-5db19c4ffaa6 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1313 microversion: 2.1 time: 0.154834 Jun 24 10:02:59.013343 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 138/264] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:58 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:02:59.053290 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=100 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:02:59.253343 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-41d26349-1fab-4195-bac5-93d9517adfec tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "POST /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6/action" status: 202 len: 0 microversion: 2.1 time: 0.255536 Jun 24 10:02:59.253971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 127/265] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Jun 24 10:02:58 2022] POST /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 10:02:59.262557 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-e11e3ec7-5aa0-459a-a46f-216dafe5dc90 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:02:59.266247 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-e11e3ec7-5aa0-459a-a46f-216dafe5dc90 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:02:59.269088 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e11e3ec7-5aa0-459a-a46f-216dafe5dc90 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:59.269535 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e11e3ec7-5aa0-459a-a46f-216dafe5dc90 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:59.270280 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e11e3ec7-5aa0-459a-a46f-216dafe5dc90 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:02:59.270709 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e11e3ec7-5aa0-459a-a46f-216dafe5dc90 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:02:59.395337 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-e11e3ec7-5aa0-459a-a46f-216dafe5dc90 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:02:59.403148 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-e11e3ec7-5aa0-459a-a46f-216dafe5dc90 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1508 microversion: 2.1 time: 0.144987 Jun 24 10:02:59.403706 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 139/266] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:02:59 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1508 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:00.029831 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-0ce32437-28e4-41cf-af44-2c609b32527f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:00.030633 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-0ce32437-28e4-41cf-af44-2c609b32527f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:00.036977 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0ce32437-28e4-41cf-af44-2c609b32527f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:00.037425 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0ce32437-28e4-41cf-af44-2c609b32527f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:00.038179 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0ce32437-28e4-41cf-af44-2c609b32527f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:00.038636 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0ce32437-28e4-41cf-af44-2c609b32527f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:00.220929 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-0ce32437-28e4-41cf-af44-2c609b32527f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:00.228482 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-0ce32437-28e4-41cf-af44-2c609b32527f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1313 microversion: 2.1 time: 0.203020 Jun 24 10:03:00.229047 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 128/267] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:00 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:00.406979 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-e7d9c9b5-bdb3-4b58-a448-03d0bceb7323 req-4fafe2f2-c5ee-41ee-9147-91fe51a473e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82a0c99c-2abd-46f4-a9a4-dee1a57b0857", "tag": "ed6b5cc2-a7e3-4ac0-abfe-e6b6113d103d"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:03:00.422291 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-e7d9c9b5-bdb3-4b58-a448-03d0bceb7323 req-4fafe2f2-c5ee-41ee-9147-91fe51a473e8 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:00.422291 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-e7d9c9b5-bdb3-4b58-a448-03d0bceb7323 req-4fafe2f2-c5ee-41ee-9147-91fe51a473e8 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:00.422751 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-9e077c29-6416-4398-a992-1c7ca2ce5989 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:00.423220 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-9e077c29-6416-4398-a992-1c7ca2ce5989 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:00.429879 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9e077c29-6416-4398-a992-1c7ca2ce5989 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:00.430336 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9e077c29-6416-4398-a992-1c7ca2ce5989 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:00.430685 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-e7d9c9b5-bdb3-4b58-a448-03d0bceb7323 req-4fafe2f2-c5ee-41ee-9147-91fe51a473e8 service nova] Creating event network-changed:ed6b5cc2-a7e3-4ac0-abfe-e6b6113d103d for instance 82a0c99c-2abd-46f4-a9a4-dee1a57b0857 on hv-cinder-84327 Jun 24 10:03:00.431111 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9e077c29-6416-4398-a992-1c7ca2ce5989 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:00.431548 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9e077c29-6416-4398-a992-1c7ca2ce5989 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:00.435565 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-e7d9c9b5-bdb3-4b58-a448-03d0bceb7323 req-4fafe2f2-c5ee-41ee-9147-91fe51a473e8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032852 Jun 24 10:03:00.436206 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 140/268] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:03:00.570052 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-9e077c29-6416-4398-a992-1c7ca2ce5989 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:00.578036 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-9e077c29-6416-4398-a992-1c7ca2ce5989 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1508 microversion: 2.1 time: 0.161061 Jun 24 10:03:00.578613 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 129/269] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:00 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:03:01.246349 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-d16c6b47-53c5-40e5-91f6-21f66542e634 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:01.246902 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-d16c6b47-53c5-40e5-91f6-21f66542e634 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:01.253332 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d16c6b47-53c5-40e5-91f6-21f66542e634 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:01.253791 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d16c6b47-53c5-40e5-91f6-21f66542e634 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:01.254565 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d16c6b47-53c5-40e5-91f6-21f66542e634 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:01.255199 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d16c6b47-53c5-40e5-91f6-21f66542e634 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:01.434061 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d16c6b47-53c5-40e5-91f6-21f66542e634 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:01.443276 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-d16c6b47-53c5-40e5-91f6-21f66542e634 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1313 microversion: 2.1 time: 0.201230 Jun 24 10:03:01.443851 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 141/270] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:01 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:01.594529 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-6aef1d61-1ccc-4ca8-9c58-edd12488b626 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:01.595153 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-6aef1d61-1ccc-4ca8-9c58-edd12488b626 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:01.601270 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6aef1d61-1ccc-4ca8-9c58-edd12488b626 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:01.601725 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6aef1d61-1ccc-4ca8-9c58-edd12488b626 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:01.603138 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6aef1d61-1ccc-4ca8-9c58-edd12488b626 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:01.603583 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6aef1d61-1ccc-4ca8-9c58-edd12488b626 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:01.829949 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-6aef1d61-1ccc-4ca8-9c58-edd12488b626 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:01.842555 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-6aef1d61-1ccc-4ca8-9c58-edd12488b626 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1508 microversion: 2.1 time: 0.251006 Jun 24 10:03:01.844899 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 130/271] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:01 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1508 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:02.460467 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-1312d1f7-71d2-457f-9bb7-2ce0b094df1c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:02.462514 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-1312d1f7-71d2-457f-9bb7-2ce0b094df1c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:02.468711 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1312d1f7-71d2-457f-9bb7-2ce0b094df1c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:02.469160 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1312d1f7-71d2-457f-9bb7-2ce0b094df1c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:02.469948 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1312d1f7-71d2-457f-9bb7-2ce0b094df1c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:02.470386 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1312d1f7-71d2-457f-9bb7-2ce0b094df1c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:02.640473 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-1312d1f7-71d2-457f-9bb7-2ce0b094df1c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:02.644339 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=100 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:03:02.648570 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-1312d1f7-71d2-457f-9bb7-2ce0b094df1c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1313 microversion: 2.1 time: 0.192295 Jun 24 10:03:02.649157 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 142/272] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:02 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:02.861220 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-d822d11b-4c1e-4fbd-a820-29909e6c197c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:02.866383 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-d822d11b-4c1e-4fbd-a820-29909e6c197c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:02.867720 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d822d11b-4c1e-4fbd-a820-29909e6c197c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:02.868193 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d822d11b-4c1e-4fbd-a820-29909e6c197c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:02.868944 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d822d11b-4c1e-4fbd-a820-29909e6c197c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:02.869373 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d822d11b-4c1e-4fbd-a820-29909e6c197c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:03.000617 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d822d11b-4c1e-4fbd-a820-29909e6c197c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:03.008279 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-d822d11b-4c1e-4fbd-a820-29909e6c197c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1508 microversion: 2.1 time: 0.150847 Jun 24 10:03:03.008847 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 131/273] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:02 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:03.666048 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-c765b811-33a1-4a68-979b-99da0a6162ea tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:03.670194 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-c765b811-33a1-4a68-979b-99da0a6162ea tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:03.682192 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c765b811-33a1-4a68-979b-99da0a6162ea tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:03.682580 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c765b811-33a1-4a68-979b-99da0a6162ea tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:03.683368 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c765b811-33a1-4a68-979b-99da0a6162ea tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:03.683804 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c765b811-33a1-4a68-979b-99da0a6162ea tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:04.005735 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-c765b811-33a1-4a68-979b-99da0a6162ea tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:04.014215 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-c765b811-33a1-4a68-979b-99da0a6162ea tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1313 microversion: 2.1 time: 0.352650 Jun 24 10:03:04.014799 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 143/274] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:03 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:04.027985 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-df37856d-8a64-40be-90dc-0f29fa6679b1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:04.028644 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-df37856d-8a64-40be-90dc-0f29fa6679b1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:04.034679 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-df37856d-8a64-40be-90dc-0f29fa6679b1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:04.035134 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-df37856d-8a64-40be-90dc-0f29fa6679b1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:04.035907 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-df37856d-8a64-40be-90dc-0f29fa6679b1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:04.036390 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-df37856d-8a64-40be-90dc-0f29fa6679b1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:04.172826 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-df37856d-8a64-40be-90dc-0f29fa6679b1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:04.185292 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-df37856d-8a64-40be-90dc-0f29fa6679b1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1508 microversion: 2.1 time: 0.159968 Jun 24 10:03:04.185292 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 132/275] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:04 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:05.030555 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-c443c3b4-8f34-4606-bcca-504b44247161 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:05.031247 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-c443c3b4-8f34-4606-bcca-504b44247161 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:05.037963 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c443c3b4-8f34-4606-bcca-504b44247161 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:05.038414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c443c3b4-8f34-4606-bcca-504b44247161 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:05.039194 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c443c3b4-8f34-4606-bcca-504b44247161 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:05.039630 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c443c3b4-8f34-4606-bcca-504b44247161 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:05.170320 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-c443c3b4-8f34-4606-bcca-504b44247161 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:05.177769 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-c443c3b4-8f34-4606-bcca-504b44247161 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1313 microversion: 2.1 time: 0.151062 Jun 24 10:03:05.178331 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 144/276] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:05 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:05.197876 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-914c08c6-2c44-4245-88d8-10c0ba063e74 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:05.201728 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-914c08c6-2c44-4245-88d8-10c0ba063e74 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:05.204493 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-914c08c6-2c44-4245-88d8-10c0ba063e74 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:05.204948 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-914c08c6-2c44-4245-88d8-10c0ba063e74 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:05.205714 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-914c08c6-2c44-4245-88d8-10c0ba063e74 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:05.206150 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-914c08c6-2c44-4245-88d8-10c0ba063e74 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:05.333823 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-914c08c6-2c44-4245-88d8-10c0ba063e74 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:05.342021 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-914c08c6-2c44-4245-88d8-10c0ba063e74 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1508 microversion: 2.1 time: 0.148171 Jun 24 10:03:05.342592 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 133/277] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:05 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:05.910449 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-4e0b4053-4c5b-40bd-be01-97e6b0a7e5cc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:05.910874 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-4e0b4053-4c5b-40bd-be01-97e6b0a7e5cc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:05.917255 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4e0b4053-4c5b-40bd-be01-97e6b0a7e5cc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:05.917704 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4e0b4053-4c5b-40bd-be01-97e6b0a7e5cc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:05.918458 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4e0b4053-4c5b-40bd-be01-97e6b0a7e5cc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:05.918893 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4e0b4053-4c5b-40bd-be01-97e6b0a7e5cc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:05.941862 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-4e0b4053-4c5b-40bd-be01-97e6b0a7e5cc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877/ips" status: 200 len: 151 microversion: 2.20 time: 0.035433 Jun 24 10:03:05.942410 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 145/278] 10.222.0.26 () {60 vars in 1288 bytes} [Fri Jun 24 10:03:05 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:03:06.194290 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-8e9828de-042a-4e7a-b6c6-7a9a7102a5c5 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:06.197669 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-8e9828de-042a-4e7a-b6c6-7a9a7102a5c5 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:06.200953 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8e9828de-042a-4e7a-b6c6-7a9a7102a5c5 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:06.201473 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8e9828de-042a-4e7a-b6c6-7a9a7102a5c5 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:06.202148 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8e9828de-042a-4e7a-b6c6-7a9a7102a5c5 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:06.202583 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8e9828de-042a-4e7a-b6c6-7a9a7102a5c5 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:06.337275 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-8e9828de-042a-4e7a-b6c6-7a9a7102a5c5 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:06.344583 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-8e9828de-042a-4e7a-b6c6-7a9a7102a5c5 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1313 microversion: 2.1 time: 0.154155 Jun 24 10:03:06.345178 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 134/279] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:06 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:06.358881 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-2a89333e-c29a-46d3-86d7-2775aa139738 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:06.361307 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-2a89333e-c29a-46d3-86d7-2775aa139738 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:06.365825 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2a89333e-c29a-46d3-86d7-2775aa139738 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:06.366281 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2a89333e-c29a-46d3-86d7-2775aa139738 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:06.367049 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2a89333e-c29a-46d3-86d7-2775aa139738 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:06.368084 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2a89333e-c29a-46d3-86d7-2775aa139738 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:06.504878 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-2a89333e-c29a-46d3-86d7-2775aa139738 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:06.512557 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-2a89333e-c29a-46d3-86d7-2775aa139738 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1508 microversion: 2.1 time: 0.157594 Jun 24 10:03:06.513141 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 146/280] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:06 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:07.362125 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-ad0e69e0-65b7-4211-9876-7e3a1f122b7c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:07.362764 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-ad0e69e0-65b7-4211-9876-7e3a1f122b7c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:07.369212 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ad0e69e0-65b7-4211-9876-7e3a1f122b7c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:07.369655 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ad0e69e0-65b7-4211-9876-7e3a1f122b7c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:07.370403 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ad0e69e0-65b7-4211-9876-7e3a1f122b7c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:07.370832 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ad0e69e0-65b7-4211-9876-7e3a1f122b7c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:07.495679 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-ad0e69e0-65b7-4211-9876-7e3a1f122b7c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:07.503053 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-ad0e69e0-65b7-4211-9876-7e3a1f122b7c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1313 microversion: 2.1 time: 0.144708 Jun 24 10:03:07.503618 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 135/281] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:07 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:07.529307 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-4bbbf279-3168-4ecd-8ae3-be2c5e483edd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:07.529913 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-4bbbf279-3168-4ecd-8ae3-be2c5e483edd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:07.536811 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4bbbf279-3168-4ecd-8ae3-be2c5e483edd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:07.537256 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4bbbf279-3168-4ecd-8ae3-be2c5e483edd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:07.538008 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4bbbf279-3168-4ecd-8ae3-be2c5e483edd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:07.538439 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4bbbf279-3168-4ecd-8ae3-be2c5e483edd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:07.666472 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-4bbbf279-3168-4ecd-8ae3-be2c5e483edd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:07.674174 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-4bbbf279-3168-4ecd-8ae3-be2c5e483edd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1508 microversion: 2.1 time: 0.148397 Jun 24 10:03:07.674725 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 147/282] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:07 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:08.520285 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-72388be3-d11f-41e1-9dfa-bcb4c7c91971 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:08.520829 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-72388be3-d11f-41e1-9dfa-bcb4c7c91971 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:08.527434 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-72388be3-d11f-41e1-9dfa-bcb4c7c91971 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:08.527888 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-72388be3-d11f-41e1-9dfa-bcb4c7c91971 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:08.528686 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-72388be3-d11f-41e1-9dfa-bcb4c7c91971 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:08.529130 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-72388be3-d11f-41e1-9dfa-bcb4c7c91971 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:08.660550 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-72388be3-d11f-41e1-9dfa-bcb4c7c91971 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:08.668164 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-72388be3-d11f-41e1-9dfa-bcb4c7c91971 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1313 microversion: 2.1 time: 0.151848 Jun 24 10:03:08.668727 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 136/283] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:08 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:08.694693 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-99c3fd59-77fe-484a-99e3-d3790599c9a2 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:08.695880 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-99c3fd59-77fe-484a-99e3-d3790599c9a2 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:08.702347 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-99c3fd59-77fe-484a-99e3-d3790599c9a2 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:08.702797 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-99c3fd59-77fe-484a-99e3-d3790599c9a2 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:08.703550 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-99c3fd59-77fe-484a-99e3-d3790599c9a2 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:08.703985 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-99c3fd59-77fe-484a-99e3-d3790599c9a2 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:08.842585 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-99c3fd59-77fe-484a-99e3-d3790599c9a2 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:08.850137 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-99c3fd59-77fe-484a-99e3-d3790599c9a2 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1508 microversion: 2.1 time: 0.159223 Jun 24 10:03:08.850692 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 148/284] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:08 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:09.684925 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-3b6cce16-3877-41d8-b971-0ba71b136667 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:09.685539 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-3b6cce16-3877-41d8-b971-0ba71b136667 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:09.691822 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3b6cce16-3877-41d8-b971-0ba71b136667 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:09.692420 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3b6cce16-3877-41d8-b971-0ba71b136667 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:09.693200 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3b6cce16-3877-41d8-b971-0ba71b136667 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:09.693634 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3b6cce16-3877-41d8-b971-0ba71b136667 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:09.823690 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-3b6cce16-3877-41d8-b971-0ba71b136667 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:09.831311 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-3b6cce16-3877-41d8-b971-0ba71b136667 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1313 microversion: 2.1 time: 0.150478 Jun 24 10:03:09.831873 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 137/285] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:09 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:09.866825 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-0d3377af-2e7d-4c8c-bd4f-e6d842daca15 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:09.867442 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-0d3377af-2e7d-4c8c-bd4f-e6d842daca15 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:09.869915 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_api:SELECT=56 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:03:09.874684 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0d3377af-2e7d-4c8c-bd4f-e6d842daca15 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:09.875136 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0d3377af-2e7d-4c8c-bd4f-e6d842daca15 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:09.875906 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0d3377af-2e7d-4c8c-bd4f-e6d842daca15 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:09.876375 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0d3377af-2e7d-4c8c-bd4f-e6d842daca15 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:10.010079 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-0d3377af-2e7d-4c8c-bd4f-e6d842daca15 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:10.017686 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-0d3377af-2e7d-4c8c-bd4f-e6d842daca15 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1508 microversion: 2.1 time: 0.154815 Jun 24 10:03:10.018248 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 149/286] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:09 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:10.849160 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-d5c4801e-9f8b-4964-890f-ad7dca2c256c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:10.849786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-d5c4801e-9f8b-4964-890f-ad7dca2c256c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:10.852063 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:03:10.856801 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d5c4801e-9f8b-4964-890f-ad7dca2c256c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:10.857247 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d5c4801e-9f8b-4964-890f-ad7dca2c256c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:10.858015 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d5c4801e-9f8b-4964-890f-ad7dca2c256c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:10.858451 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d5c4801e-9f8b-4964-890f-ad7dca2c256c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:11.010832 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d5c4801e-9f8b-4964-890f-ad7dca2c256c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:11.018110 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-d5c4801e-9f8b-4964-890f-ad7dca2c256c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1313 microversion: 2.1 time: 0.173596 Jun 24 10:03:11.018985 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 138/287] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:10 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:11.035130 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-97509930-78b5-49cf-93e4-13cbd46327ed tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:11.038432 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-97509930-78b5-49cf-93e4-13cbd46327ed tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:11.042717 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-97509930-78b5-49cf-93e4-13cbd46327ed tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:11.043162 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-97509930-78b5-49cf-93e4-13cbd46327ed tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:11.043937 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-97509930-78b5-49cf-93e4-13cbd46327ed tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:11.044380 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-97509930-78b5-49cf-93e4-13cbd46327ed tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:11.175066 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-97509930-78b5-49cf-93e4-13cbd46327ed tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:11.183246 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-97509930-78b5-49cf-93e4-13cbd46327ed tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1508 microversion: 2.1 time: 0.152148 Jun 24 10:03:11.188734 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 150/288] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:11 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:12.017226 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-484b9ac2-c8aa-40a4-b8a2-bc3b4872d69c req-33790c62-b331-4b8e-8c56-0c0c71f30a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a0c99c-2abd-46f4-a9a4-dee1a57b0857", "name": "network-vif-plugged", "status": "completed", "tag": "ed6b5cc2-a7e3-4ac0-abfe-e6b6113d103d"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:03:12.027730 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-4c9dd83f-32d7-44df-940a-535e96ef3fa8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:03:12.030782 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-484b9ac2-c8aa-40a4-b8a2-bc3b4872d69c req-33790c62-b331-4b8e-8c56-0c0c71f30a05 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:12.031275 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-4c9dd83f-32d7-44df-940a-535e96ef3fa8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:12.033381 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-484b9ac2-c8aa-40a4-b8a2-bc3b4872d69c req-33790c62-b331-4b8e-8c56-0c0c71f30a05 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:12.038247 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4c9dd83f-32d7-44df-940a-535e96ef3fa8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:12.045001 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4c9dd83f-32d7-44df-940a-535e96ef3fa8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:12.045001 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4c9dd83f-32d7-44df-940a-535e96ef3fa8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:12.045001 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4c9dd83f-32d7-44df-940a-535e96ef3fa8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:12.048506 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-484b9ac2-c8aa-40a4-b8a2-bc3b4872d69c req-33790c62-b331-4b8e-8c56-0c0c71f30a05 service nova] Creating event network-vif-plugged:ed6b5cc2-a7e3-4ac0-abfe-e6b6113d103d for instance 82a0c99c-2abd-46f4-a9a4-dee1a57b0857 on hv-cinder-84327 Jun 24 10:03:12.065249 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-484b9ac2-c8aa-40a4-b8a2-bc3b4872d69c req-33790c62-b331-4b8e-8c56-0c0c71f30a05 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051786 Jun 24 10:03:12.066625 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 139/289] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:03:12.073923 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-2c15ec39-c06d-44fb-901f-7d1685f4885f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:12.079403 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-2c15ec39-c06d-44fb-901f-7d1685f4885f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:12.079517 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.objects.instance [None req-4c9dd83f-32d7-44df-940a-535e96ef3fa8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lazy-loading 'flavor' on Instance uuid 904eb348-521e-499e-8127-cb3096230877 {{(pid=124979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:03:12.091649 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2c15ec39-c06d-44fb-901f-7d1685f4885f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:12.092532 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2c15ec39-c06d-44fb-901f-7d1685f4885f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:12.093585 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2c15ec39-c06d-44fb-901f-7d1685f4885f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:12.094219 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2c15ec39-c06d-44fb-901f-7d1685f4885f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:12.260768 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2c15ec39-c06d-44fb-901f-7d1685f4885f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:12.267967 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-2c15ec39-c06d-44fb-901f-7d1685f4885f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1313 microversion: 2.1 time: 0.199585 Jun 24 10:03:12.268571 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 140/290] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:12 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:12.272937 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-ce626694-a460-4c2f-a142-88d903997c39 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:12.273546 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-ce626694-a460-4c2f-a142-88d903997c39 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:12.279079 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ce626694-a460-4c2f-a142-88d903997c39 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:12.279536 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ce626694-a460-4c2f-a142-88d903997c39 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:12.280341 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ce626694-a460-4c2f-a142-88d903997c39 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:12.280784 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ce626694-a460-4c2f-a142-88d903997c39 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:12.417706 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-ce626694-a460-4c2f-a142-88d903997c39 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:12.427399 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-ce626694-a460-4c2f-a142-88d903997c39 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1514 microversion: 2.1 time: 0.155869 Jun 24 10:03:12.427399 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 141/291] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:12 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:12.745966 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-4c9dd83f-32d7-44df-940a-535e96ef3fa8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "POST /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877/action" status: 202 len: 0 microversion: 2.20 time: 0.724869 Jun 24 10:03:12.746747 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 151/292] 10.222.0.26 () {62 vars in 1318 bytes} [Fri Jun 24 10:03:12 2022] POST /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877/action => generated 0 bytes in 726 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 24 10:03:12.754998 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-664cc889-d9b3-42cd-a14f-93739cb2f74f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:12.755612 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-664cc889-d9b3-42cd-a14f-93739cb2f74f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:12.762772 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-664cc889-d9b3-42cd-a14f-93739cb2f74f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:12.763659 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-664cc889-d9b3-42cd-a14f-93739cb2f74f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:12.763995 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-664cc889-d9b3-42cd-a14f-93739cb2f74f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:12.764470 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-664cc889-d9b3-42cd-a14f-93739cb2f74f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:12.899611 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-664cc889-d9b3-42cd-a14f-93739cb2f74f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:12.908773 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-664cc889-d9b3-42cd-a14f-93739cb2f74f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:12.910366 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-664cc889-d9b3-42cd-a14f-93739cb2f74f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:12.911567 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-664cc889-d9b3-42cd-a14f-93739cb2f74f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1721 microversion: 2.20 time: 0.160508 Jun 24 10:03:12.912148 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 142/293] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:12 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:03:13.285680 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-185c8485-cd1c-4333-92e3-6017e2a3d208 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:13.286316 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-185c8485-cd1c-4333-92e3-6017e2a3d208 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:13.292972 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-185c8485-cd1c-4333-92e3-6017e2a3d208 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:13.293441 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-185c8485-cd1c-4333-92e3-6017e2a3d208 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:13.294204 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-185c8485-cd1c-4333-92e3-6017e2a3d208 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:13.294642 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-185c8485-cd1c-4333-92e3-6017e2a3d208 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:13.425983 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-185c8485-cd1c-4333-92e3-6017e2a3d208 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:13.434400 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-185c8485-cd1c-4333-92e3-6017e2a3d208 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1313 microversion: 2.1 time: 0.153567 Jun 24 10:03:13.435298 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 152/294] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:13 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:13.493414 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-e1cfd49c-235a-438f-8abb-baa6ff91e5c0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:13.494435 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-e1cfd49c-235a-438f-8abb-baa6ff91e5c0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:13.500539 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e1cfd49c-235a-438f-8abb-baa6ff91e5c0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:13.500986 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e1cfd49c-235a-438f-8abb-baa6ff91e5c0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:13.501738 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e1cfd49c-235a-438f-8abb-baa6ff91e5c0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:13.502169 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e1cfd49c-235a-438f-8abb-baa6ff91e5c0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:13.524883 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-e1cfd49c-235a-438f-8abb-baa6ff91e5c0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e/ips" status: 200 len: 146 microversion: 2.1 time: 0.035269 Jun 24 10:03:13.525434 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 143/295] 10.222.0.26 () {58 vars in 1247 bytes} [Fri Jun 24 10:03:13 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e/ips => generated 146 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:03:13.930574 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-d579c74d-6546-4724-9293-41b89ca154d0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:13.931848 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-d579c74d-6546-4724-9293-41b89ca154d0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:13.937919 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d579c74d-6546-4724-9293-41b89ca154d0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:13.938372 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d579c74d-6546-4724-9293-41b89ca154d0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:13.939125 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d579c74d-6546-4724-9293-41b89ca154d0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:13.939559 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d579c74d-6546-4724-9293-41b89ca154d0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:14.066212 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d579c74d-6546-4724-9293-41b89ca154d0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:14.074093 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d579c74d-6546-4724-9293-41b89ca154d0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:14.075623 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d579c74d-6546-4724-9293-41b89ca154d0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:14.076840 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-d579c74d-6546-4724-9293-41b89ca154d0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1721 microversion: 2.20 time: 0.150072 Jun 24 10:03:14.077482 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 153/296] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:13 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:03:14.452374 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-1eed902f-342d-4cdf-990f-beaa49d0c04f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:14.452993 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-1eed902f-342d-4cdf-990f-beaa49d0c04f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:14.459739 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1eed902f-342d-4cdf-990f-beaa49d0c04f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:14.461503 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1eed902f-342d-4cdf-990f-beaa49d0c04f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:14.461503 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1eed902f-342d-4cdf-990f-beaa49d0c04f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:14.461503 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1eed902f-342d-4cdf-990f-beaa49d0c04f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:14.592284 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-1eed902f-342d-4cdf-990f-beaa49d0c04f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:14.595970 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:03:14.600879 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-1eed902f-342d-4cdf-990f-beaa49d0c04f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1313 microversion: 2.1 time: 0.152420 Jun 24 10:03:14.601441 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 144/297] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:14 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:15.095472 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-d3430bdd-4902-4dd4-a6ba-d8c7f453ee1d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:15.096086 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-d3430bdd-4902-4dd4-a6ba-d8c7f453ee1d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:15.103876 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d3430bdd-4902-4dd4-a6ba-d8c7f453ee1d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:15.104552 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d3430bdd-4902-4dd4-a6ba-d8c7f453ee1d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:15.105486 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d3430bdd-4902-4dd4-a6ba-d8c7f453ee1d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:15.106523 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d3430bdd-4902-4dd4-a6ba-d8c7f453ee1d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:15.260405 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d3430bdd-4902-4dd4-a6ba-d8c7f453ee1d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:15.268898 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d3430bdd-4902-4dd4-a6ba-d8c7f453ee1d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:15.270389 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d3430bdd-4902-4dd4-a6ba-d8c7f453ee1d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:15.271529 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-d3430bdd-4902-4dd4-a6ba-d8c7f453ee1d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1721 microversion: 2.20 time: 0.180072 Jun 24 10:03:15.272084 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 154/298] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:15 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:03:15.618070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-7d7340f2-a49b-407d-99a3-c709e8f78bc0 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:15.618726 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-7d7340f2-a49b-407d-99a3-c709e8f78bc0 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:15.625664 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7d7340f2-a49b-407d-99a3-c709e8f78bc0 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:15.626119 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7d7340f2-a49b-407d-99a3-c709e8f78bc0 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:15.628238 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7d7340f2-a49b-407d-99a3-c709e8f78bc0 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:15.628689 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7d7340f2-a49b-407d-99a3-c709e8f78bc0 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:15.811584 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-7d7340f2-a49b-407d-99a3-c709e8f78bc0 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:15.811584 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-7d7340f2-a49b-407d-99a3-c709e8f78bc0 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1313 microversion: 2.1 time: 0.197310 Jun 24 10:03:15.812801 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 145/299] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:15 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:03:16.217708 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-ba4d957d-e44c-4f58-b94e-1657dd05fffa tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Action: 'create', calling method: .version_select at 0x7f0309e8b160>, body: {"keypair": {"name": "tempest-keypair-291821548", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/6t1AlNV1ZtvNhsO8tUpqNgdvHWZLFBuVXpTYB4a3Jopd/R+9gHd+dvMvs2vLEXYVCMozfQXkA0n+iXRbjy0WX8b4BnayM4+KtL5p3Y86uAYMr+V4lLwVSdEW5XiSLFA=="}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:03:16.232516 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-ba4d957d-e44c-4f58-b94e-1657dd05fffa tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Getting quotas for project ddf89eff2d584c508a967f1686090be1. Resources: {'key_pairs'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:03:16.236534 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-ba4d957d-e44c-4f58-b94e-1657dd05fffa tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Getting quotas for user b03913e742104648977aa5d61347f38e and project ddf89eff2d584c508a967f1686090be1. Resources: {'key_pairs'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:03:16.290575 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-2da7e67d-716a-4d3b-8712-0d93f7951946 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:16.292011 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-2da7e67d-716a-4d3b-8712-0d93f7951946 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:16.299288 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2da7e67d-716a-4d3b-8712-0d93f7951946 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:16.299769 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2da7e67d-716a-4d3b-8712-0d93f7951946 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:16.300613 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2da7e67d-716a-4d3b-8712-0d93f7951946 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:16.301094 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2da7e67d-716a-4d3b-8712-0d93f7951946 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:16.377245 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-ba4d957d-e44c-4f58-b94e-1657dd05fffa tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.163329 Jun 24 10:03:16.377841 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 155/300] 10.222.0.26 () {60 vars in 1158 bytes} [Fri Jun 24 10:03:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:03:16.438241 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2da7e67d-716a-4d3b-8712-0d93f7951946 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:16.446507 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2da7e67d-716a-4d3b-8712-0d93f7951946 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:16.448062 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2da7e67d-716a-4d3b-8712-0d93f7951946 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:16.459966 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-2da7e67d-716a-4d3b-8712-0d93f7951946 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1721 microversion: 2.20 time: 0.162956 Jun 24 10:03:16.459966 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 146/301] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:16 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:03:16.830908 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-54bee825-2128-4917-a239-b2fba6253e0b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:16.831642 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-54bee825-2128-4917-a239-b2fba6253e0b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:16.838724 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-54bee825-2128-4917-a239-b2fba6253e0b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:16.844058 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-54bee825-2128-4917-a239-b2fba6253e0b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:16.844058 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-54bee825-2128-4917-a239-b2fba6253e0b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:16.844058 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-54bee825-2128-4917-a239-b2fba6253e0b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:16.949255 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-a130b7a4-2990-424d-b9f9-a31a52ad4fdd tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f02bea62-3bab-42dc-87ac-e3d9d5d96bd3"}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:03:16.950380 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-a130b7a4-2990-424d-b9f9-a31a52ad4fdd tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:16.957045 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a130b7a4-2990-424d-b9f9-a31a52ad4fdd tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:16.957496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a130b7a4-2990-424d-b9f9-a31a52ad4fdd tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:16.958261 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a130b7a4-2990-424d-b9f9-a31a52ad4fdd tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:16.958758 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a130b7a4-2990-424d-b9f9-a31a52ad4fdd tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:17.015361 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-54bee825-2128-4917-a239-b2fba6253e0b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:17.024492 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-54bee825-2128-4917-a239-b2fba6253e0b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1313 microversion: 2.1 time: 0.197578 Jun 24 10:03:17.025200 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 156/302] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:16 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:17.471310 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-0730dd90-6b8e-40b0-97a5-003ae6d208dc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:17.471904 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-0730dd90-6b8e-40b0-97a5-003ae6d208dc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:17.483083 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0730dd90-6b8e-40b0-97a5-003ae6d208dc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:17.483689 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0730dd90-6b8e-40b0-97a5-003ae6d208dc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:17.485417 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0730dd90-6b8e-40b0-97a5-003ae6d208dc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:17.485956 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0730dd90-6b8e-40b0-97a5-003ae6d208dc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:17.626271 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-0730dd90-6b8e-40b0-97a5-003ae6d208dc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:17.635760 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-0730dd90-6b8e-40b0-97a5-003ae6d208dc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:17.637460 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-0730dd90-6b8e-40b0-97a5-003ae6d208dc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:17.638891 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-0730dd90-6b8e-40b0-97a5-003ae6d208dc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1721 microversion: 2.20 time: 0.174519 Jun 24 10:03:17.639441 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 157/303] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:17 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:03:18.042877 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-8a643349-a4ef-472a-817a-64af890e1d32 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:18.043785 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-8a643349-a4ef-472a-817a-64af890e1d32 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:18.050479 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8a643349-a4ef-472a-817a-64af890e1d32 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:18.052372 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8a643349-a4ef-472a-817a-64af890e1d32 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:18.052372 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8a643349-a4ef-472a-817a-64af890e1d32 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:18.052372 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8a643349-a4ef-472a-817a-64af890e1d32 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:18.213627 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-a130b7a4-2990-424d-b9f9-a31a52ad4fdd tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "POST /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.266365 Jun 24 10:03:18.214265 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 147/304] 10.222.0.26 () {60 vars in 1322 bytes} [Fri Jun 24 10:03:16 2022] POST /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e/os-volume_attachments => generated 194 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:03:18.283624 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-8a643349-a4ef-472a-817a-64af890e1d32 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:18.287437 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:03:18.296985 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-8a643349-a4ef-472a-817a-64af890e1d32 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1497 microversion: 2.1 time: 0.259336 Jun 24 10:03:18.297885 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 158/305] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:18 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1497 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:03:18.657771 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-75cf8114-c264-4b9a-bf16-1669043ad821 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:18.658666 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-75cf8114-c264-4b9a-bf16-1669043ad821 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:18.666308 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-75cf8114-c264-4b9a-bf16-1669043ad821 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:18.666821 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-75cf8114-c264-4b9a-bf16-1669043ad821 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:18.667669 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-75cf8114-c264-4b9a-bf16-1669043ad821 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:18.668232 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-75cf8114-c264-4b9a-bf16-1669043ad821 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:18.833493 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-75cf8114-c264-4b9a-bf16-1669043ad821 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:18.841737 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-75cf8114-c264-4b9a-bf16-1669043ad821 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:18.843527 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-75cf8114-c264-4b9a-bf16-1669043ad821 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:18.844837 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-75cf8114-c264-4b9a-bf16-1669043ad821 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1721 microversion: 2.20 time: 0.191471 Jun 24 10:03:18.856188 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 148/306] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:18 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:03:19.426465 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-def65225-6bbd-4508-85f6-3a8d0e99e5f9 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1737804275", "imageRef": "f6b1dddb-2953-41a2-99e3-00aeca441bd9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa5f3eea-22fa-49e9-863b-48d0ee7aa7fa"}], "security_groups": [{"name": "tempest-securitygroup--1147626857"}], "key_name": "tempest-keypair-291821548", "user_data": "}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:03:19.557748 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.network.neutron [None req-def65225-6bbd-4508-85f6-3a8d0e99e5f9 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] validate_networks() for [('fa5f3eea-22fa-49e9-863b-48d0ee7aa7fa', None, None, None, None, None)] {{(pid=124979) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:03:19.636196 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-0989f56b-19f8-4aee-ab31-fd45971c9a86 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:19.636786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-0989f56b-19f8-4aee-ab31-fd45971c9a86 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:19.650595 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0989f56b-19f8-4aee-ab31-fd45971c9a86 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:19.651169 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0989f56b-19f8-4aee-ab31-fd45971c9a86 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:19.652453 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0989f56b-19f8-4aee-ab31-fd45971c9a86 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:19.653198 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0989f56b-19f8-4aee-ab31-fd45971c9a86 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:19.879103 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-0989f56b-19f8-4aee-ab31-fd45971c9a86 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Going to try to terminate instance {{(pid=124980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:03:20.170906 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-def65225-6bbd-4508-85f6-3a8d0e99e5f9 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Flavor limits 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:03:20.171320 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-def65225-6bbd-4508-85f6-3a8d0e99e5f9 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Image limits 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:03:20.171851 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-def65225-6bbd-4508-85f6-3a8d0e99e5f9 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Flavor pref 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:03:20.172299 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-def65225-6bbd-4508-85f6-3a8d0e99e5f9 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Image pref 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:03:20.172776 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-def65225-6bbd-4508-85f6-3a8d0e99e5f9 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:03:20.183176 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-def65225-6bbd-4508-85f6-3a8d0e99e5f9 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:20.183641 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-def65225-6bbd-4508-85f6-3a8d0e99e5f9 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:20.184503 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-def65225-6bbd-4508-85f6-3a8d0e99e5f9 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:20.184982 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-def65225-6bbd-4508-85f6-3a8d0e99e5f9 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:20.205736 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-def65225-6bbd-4508-85f6-3a8d0e99e5f9 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Getting quotas for project ddf89eff2d584c508a967f1686090be1. Resources: {'instances', 'cores', 'ram'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:03:20.210305 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-def65225-6bbd-4508-85f6-3a8d0e99e5f9 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Getting quotas for user b03913e742104648977aa5d61347f38e and project ddf89eff2d584c508a967f1686090be1. Resources: {'instances', 'cores', 'ram'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:03:20.222397 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-def65225-6bbd-4508-85f6-3a8d0e99e5f9 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Going to run 1 instances... {{(pid=124979) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:03:20.224729 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-def65225-6bbd-4508-85f6-3a8d0e99e5f9 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6b1dddb-2953-41a2-99e3-00aeca441bd9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124979) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:03:20.280078 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-0989f56b-19f8-4aee-ab31-fd45971c9a86 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "DELETE /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 204 len: 0 microversion: 2.1 time: 0.649327 Jun 24 10:03:20.281618 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 149/307] 10.222.0.26 () {58 vars in 1238 bytes} [Fri Jun 24 10:03:19 2022] DELETE /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:03:20.292325 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-9a909a94-9146-47c6-89e9-4040a26681d1 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:20.293379 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-9a909a94-9146-47c6-89e9-4040a26681d1 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:20.299627 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9a909a94-9146-47c6-89e9-4040a26681d1 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:20.300440 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9a909a94-9146-47c6-89e9-4040a26681d1 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:20.301664 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9a909a94-9146-47c6-89e9-4040a26681d1 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:20.302153 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9a909a94-9146-47c6-89e9-4040a26681d1 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:20.424832 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-def65225-6bbd-4508-85f6-3a8d0e99e5f9 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.002637 Jun 24 10:03:20.425685 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 159/308] 10.222.0.26 () {60 vars in 1146 bytes} [Fri Jun 24 10:03:19 2022] POST /compute/v2.1/servers => generated 409 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 10:03:20.431414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-49b6cd86-31ca-45a0-9f1e-b0c4538a1a77 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:20.432018 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-49b6cd86-31ca-45a0-9f1e-b0c4538a1a77 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:20.444310 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-49b6cd86-31ca-45a0-9f1e-b0c4538a1a77 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:20.444965 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-49b6cd86-31ca-45a0-9f1e-b0c4538a1a77 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:20.460539 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-49b6cd86-31ca-45a0-9f1e-b0c4538a1a77 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:20.462136 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-49b6cd86-31ca-45a0-9f1e-b0c4538a1a77 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:20.482363 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-9a909a94-9146-47c6-89e9-4040a26681d1 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:20.491037 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-9a909a94-9146-47c6-89e9-4040a26681d1 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:20.492618 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-9a909a94-9146-47c6-89e9-4040a26681d1 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:20.494023 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-9a909a94-9146-47c6-89e9-4040a26681d1 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1721 microversion: 2.20 time: 0.207567 Jun 24 10:03:20.494943 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 150/309] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:20 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:03:20.501249 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-de080880-cc37-4359-90b6-6952b95a980b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:20.501860 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-de080880-cc37-4359-90b6-6952b95a980b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:20.580424 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-de080880-cc37-4359-90b6-6952b95a980b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:20.588019 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-de080880-cc37-4359-90b6-6952b95a980b tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1245 microversion: 2.1 time: 0.091926 Jun 24 10:03:20.588620 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 151/310] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:20 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:20.663013 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-49b6cd86-31ca-45a0-9f1e-b0c4538a1a77 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:20.672314 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-49b6cd86-31ca-45a0-9f1e-b0c4538a1a77 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1503 microversion: 2.1 time: 0.245445 Jun 24 10:03:20.672974 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 160/311] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:20 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1503 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:21.512180 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-d9e126ed-c0d2-4cd4-846d-721ba6c763bd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:21.512801 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-d9e126ed-c0d2-4cd4-846d-721ba6c763bd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:21.519975 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d9e126ed-c0d2-4cd4-846d-721ba6c763bd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:21.520482 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d9e126ed-c0d2-4cd4-846d-721ba6c763bd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:21.521287 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d9e126ed-c0d2-4cd4-846d-721ba6c763bd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:21.521730 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d9e126ed-c0d2-4cd4-846d-721ba6c763bd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:21.604853 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-1e1ca27e-7996-4679-971a-4058ab1d31bb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:21.606104 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-1e1ca27e-7996-4679-971a-4058ab1d31bb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:21.621582 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1e1ca27e-7996-4679-971a-4058ab1d31bb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:21.622311 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1e1ca27e-7996-4679-971a-4058ab1d31bb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:21.623450 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1e1ca27e-7996-4679-971a-4058ab1d31bb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:21.624768 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1e1ca27e-7996-4679-971a-4058ab1d31bb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:21.675332 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d9e126ed-c0d2-4cd4-846d-721ba6c763bd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:21.686100 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d9e126ed-c0d2-4cd4-846d-721ba6c763bd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:21.687881 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d9e126ed-c0d2-4cd4-846d-721ba6c763bd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:21.689544 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-d9e126ed-c0d2-4cd4-846d-721ba6c763bd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1721 microversion: 2.20 time: 0.181129 Jun 24 10:03:21.693614 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 152/312] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:21 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:03:21.695717 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-ccfd4353-9141-49a4-9498-cdb982471228 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:21.696577 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-ccfd4353-9141-49a4-9498-cdb982471228 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:21.703836 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ccfd4353-9141-49a4-9498-cdb982471228 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:21.704540 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ccfd4353-9141-49a4-9498-cdb982471228 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:21.705513 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ccfd4353-9141-49a4-9498-cdb982471228 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:21.706141 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ccfd4353-9141-49a4-9498-cdb982471228 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:21.744508 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-1e1ca27e-7996-4679-971a-4058ab1d31bb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:21.744508 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-1e1ca27e-7996-4679-971a-4058ab1d31bb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1249 microversion: 2.1 time: 0.141452 Jun 24 10:03:21.744508 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 161/313] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:21 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1249 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:03:21.871068 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-ccfd4353-9141-49a4-9498-cdb982471228 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:21.879299 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-ccfd4353-9141-49a4-9498-cdb982471228 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1503 microversion: 2.1 time: 0.187600 Jun 24 10:03:21.890623 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 153/314] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:21 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1503 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:22.492619 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-4888cf60-45eb-4cc0-8987-4d0a76be9106 req-ee462974-bd35-4cac-8f6a-275eef84b40a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a0c99c-2abd-46f4-a9a4-dee1a57b0857", "name": "network-vif-deleted", "tag": "ed6b5cc2-a7e3-4ac0-abfe-e6b6113d103d"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:03:22.501982 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-4888cf60-45eb-4cc0-8987-4d0a76be9106 req-ee462974-bd35-4cac-8f6a-275eef84b40a service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:22.503562 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-4888cf60-45eb-4cc0-8987-4d0a76be9106 req-ee462974-bd35-4cac-8f6a-275eef84b40a service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:22.524367 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-4888cf60-45eb-4cc0-8987-4d0a76be9106 req-ee462974-bd35-4cac-8f6a-275eef84b40a service nova] Creating event network-vif-deleted:ed6b5cc2-a7e3-4ac0-abfe-e6b6113d103d for instance 82a0c99c-2abd-46f4-a9a4-dee1a57b0857 on hv-cinder-84327 Jun 24 10:03:22.534962 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-4888cf60-45eb-4cc0-8987-4d0a76be9106 req-ee462974-bd35-4cac-8f6a-275eef84b40a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046259 Jun 24 10:03:22.538551 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 162/315] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:03:22.715850 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-83b34852-98e2-414d-8d27-013b9997f774 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:22.717191 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-83b34852-98e2-414d-8d27-013b9997f774 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:22.724663 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-83b34852-98e2-414d-8d27-013b9997f774 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:22.726648 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-83b34852-98e2-414d-8d27-013b9997f774 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:22.731456 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-83b34852-98e2-414d-8d27-013b9997f774 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:22.731913 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-83b34852-98e2-414d-8d27-013b9997f774 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:22.768698 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-715ecb7e-7d88-44eb-99c5-0e3e8fc8e2c8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:22.768698 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-715ecb7e-7d88-44eb-99c5-0e3e8fc8e2c8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:22.793323 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-715ecb7e-7d88-44eb-99c5-0e3e8fc8e2c8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:22.793856 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-715ecb7e-7d88-44eb-99c5-0e3e8fc8e2c8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:22.794792 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-715ecb7e-7d88-44eb-99c5-0e3e8fc8e2c8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:22.795299 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-715ecb7e-7d88-44eb-99c5-0e3e8fc8e2c8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:22.867612 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-715ecb7e-7d88-44eb-99c5-0e3e8fc8e2c8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:22.879590 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-715ecb7e-7d88-44eb-99c5-0e3e8fc8e2c8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1297 microversion: 2.1 time: 0.125639 Jun 24 10:03:22.880716 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 163/316] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:22 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1297 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:22.897341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-21ee9b1a-cb75-4fe0-ad7e-f16a95da6390 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:22.898269 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-21ee9b1a-cb75-4fe0-ad7e-f16a95da6390 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:22.905377 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-21ee9b1a-cb75-4fe0-ad7e-f16a95da6390 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:22.909273 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-21ee9b1a-cb75-4fe0-ad7e-f16a95da6390 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:22.910323 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-21ee9b1a-cb75-4fe0-ad7e-f16a95da6390 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:22.911034 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-21ee9b1a-cb75-4fe0-ad7e-f16a95da6390 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:22.949899 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-21ee9b1a-cb75-4fe0-ad7e-f16a95da6390 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:22.950527 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-21ee9b1a-cb75-4fe0-ad7e-f16a95da6390 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:22.951082 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.objects.instance [None req-21ee9b1a-cb75-4fe0-ad7e-f16a95da6390 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lazy-loading 'fault' on Instance uuid 82a0c99c-2abd-46f4-a9a4-dee1a57b0857 {{(pid=124979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:03:23.062724 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-21ee9b1a-cb75-4fe0-ad7e-f16a95da6390 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:23.097202 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-21ee9b1a-cb75-4fe0-ad7e-f16a95da6390 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 200 len: 1303 microversion: 2.1 time: 0.198016 Jun 24 10:03:23.100162 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 164/317] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:22 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 1303 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:23.222075 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-83b34852-98e2-414d-8d27-013b9997f774 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:23.232331 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-83b34852-98e2-414d-8d27-013b9997f774 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:23.234601 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-83b34852-98e2-414d-8d27-013b9997f774 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:23.236337 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-83b34852-98e2-414d-8d27-013b9997f774 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1721 microversion: 2.20 time: 0.525866 Jun 24 10:03:23.241310 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 154/318] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:22 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1721 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:03:23.896546 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-98fcb8be-1c5e-4c3e-a52e-42eb8496c9bc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:23.897159 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-98fcb8be-1c5e-4c3e-a52e-42eb8496c9bc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:23.903263 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-98fcb8be-1c5e-4c3e-a52e-42eb8496c9bc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:23.903714 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-98fcb8be-1c5e-4c3e-a52e-42eb8496c9bc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:23.905114 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-98fcb8be-1c5e-4c3e-a52e-42eb8496c9bc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:23.905349 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-98fcb8be-1c5e-4c3e-a52e-42eb8496c9bc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:24.001105 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-98fcb8be-1c5e-4c3e-a52e-42eb8496c9bc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:24.009805 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-98fcb8be-1c5e-4c3e-a52e-42eb8496c9bc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1303 microversion: 2.1 time: 0.116998 Jun 24 10:03:24.010694 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 165/319] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:23 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:24.119435 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-d4c6ee01-ede4-40c3-8ad1-b508e9ed387a tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:24.120069 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-d4c6ee01-ede4-40c3-8ad1-b508e9ed387a tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: 82a0c99c-2abd-46f4-a9a4-dee1a57b0857] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:24.127182 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d4c6ee01-ede4-40c3-8ad1-b508e9ed387a tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:24.127986 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d4c6ee01-ede4-40c3-8ad1-b508e9ed387a tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:24.128854 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d4c6ee01-ede4-40c3-8ad1-b508e9ed387a tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:24.129907 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d4c6ee01-ede4-40c3-8ad1-b508e9ed387a tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:24.146691 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.wsgi [None req-d4c6ee01-ede4-40c3-8ad1-b508e9ed387a tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] HTTP exception thrown: Instance 82a0c99c-2abd-46f4-a9a4-dee1a57b0857 could not be found. Jun 24 10:03:24.148411 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-d4c6ee01-ede4-40c3-8ad1-b508e9ed387a tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Request method failure captured: Jun 24 10:03:24.148411 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: request: GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 HTTP/1.1 Jun 24 10:03:24.148411 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept: application/json Jun 24 10:03:24.148411 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept-Encoding: identity Jun 24 10:03:24.148411 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Connection: close Jun 24 10:03:24.148411 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Length: 0 Jun 24 10:03:24.148411 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Type: application/json Jun 24 10:03:24.148411 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Host: 10.222.0.26 Jun 24 10:03:24.148411 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Openstack-System-Scope: None Jun 24 10:03:24.148411 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: User-Agent: python-urllib3/1.26.9 Jun 24 10:03:24.148411 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Auth-Token: gAAAAABitYu7D_GarVoOmf-ivaKDHwIsvjqspiTOWplbHrY2ukG0Qpb3IIDDcAso5o5JNTVcUJHeHwcp5toIbG_A9wranxfOTiw7Gdjvz03wFx8LxTb6VGlNGqLp3lurr8s8lB9qvtbKXQSFgR-nHagrNdKDd9tdxN26Wo6Zj0ec3P9dFY4QCEA Jun 24 10:03:24.148411 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Id: None Jun 24 10:03:24.148411 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Name: None Jun 24 10:03:24.148411 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Identity-Status: Confirmed Jun 24 10:03:24.148411 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Is-Admin-Project: True Jun 24 10:03:24.148411 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Id: default Jun 24 10:03:24.148411 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Name: Default Jun 24 10:03:24.148411 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Id: f896de1750fe4c7d9eef897027efb42f Jun 24 10:03:24.148411 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Name: tempest-VolumesActionsTest-198756669 Jun 24 10:03:24.148411 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Role: reader,member Jun 24 10:03:24.148411 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Roles: reader,member Jun 24 10:03:24.149717 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f896de1750fe4c7d9eef897027efb42f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f896de1750fe4c7d9eef897027efb42f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f896de1750fe4c7d9eef897027efb42f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f896de1750fe4c7d9eef897027efb42f"}]}] Jun 24 10:03:24.149717 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant: tempest-VolumesActionsTest-198756669 Jun 24 10:03:24.149717 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Id: f896de1750fe4c7d9eef897027efb42f Jun 24 10:03:24.149717 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Name: tempest-VolumesActionsTest-198756669 Jun 24 10:03:24.149717 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User: tempest-VolumesActionsTest-198756669-project Jun 24 10:03:24.149717 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Id: default Jun 24 10:03:24.149717 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Name: Default Jun 24 10:03:24.149717 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Id: ff0cf4a0b4e04ce79340bac70992bf32 Jun 24 10:03:24.149717 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Name: tempest-VolumesActionsTest-198756669-project Jun 24 10:03:24.149717 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: method: > Jun 24 10:03:24.149717 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: exception: Instance 82a0c99c-2abd-46f4-a9a4-dee1a57b0857 could not be found. Jun 24 10:03:24.149717 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: action_args: {'id': '82a0c99c-2abd-46f4-a9a4-dee1a57b0857'} Jun 24 10:03:24.150976 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:03:24.150976 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:03:24.150976 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:03:24.150976 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:03:24.150976 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:03:24.150976 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:03:24.150976 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:03:24.150976 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:03:24.150976 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:03:24.150976 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:03:24.150976 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82a0c99c-2abd-46f4-a9a4-dee1a57b0857 could not be found. Jun 24 10:03:24.150976 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:03:24.150976 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:03:24.150976 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:03:24.150976 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:03:24.150976 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:03:24.150976 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:03:24.150976 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:03:24.150976 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:03:24.150976 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:03:24.152289 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:03:24.152289 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:03:24.152289 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:03:24.152289 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:03:24.152289 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:03:24.152289 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:03:24.152289 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:03:24.152289 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82a0c99c-2abd-46f4-a9a4-dee1a57b0857 could not be found. Jun 24 10:03:24.152289 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:03:24.152289 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:03:24.152289 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:03:24.152289 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:03:24.152289 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:03:24.152289 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:03:24.152289 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:03:24.152289 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:03:24.152289 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82a0c99c-2abd-46f4-a9a4-dee1a57b0857 could not be found. Jun 24 10:03:24.152289 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:03:24.153352 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-d4c6ee01-ede4-40c3-8ad1-b508e9ed387a tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Returning 404 to user: Instance 82a0c99c-2abd-46f4-a9a4-dee1a57b0857 could not be found. {{(pid=124980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:03:24.153352 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-d4c6ee01-ede4-40c3-8ad1-b508e9ed387a tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857" status: 404 len: 111 microversion: 2.1 time: 0.035453 Jun 24 10:03:24.154257 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 155/320] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:24 2022] GET /compute/v2.1/servers/82a0c99c-2abd-46f4-a9a4-dee1a57b0857 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:03:24.258530 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-6c5f41a4-ccf5-407a-aa6c-9a05a35b1c5f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:24.259188 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-6c5f41a4-ccf5-407a-aa6c-9a05a35b1c5f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:24.265371 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6c5f41a4-ccf5-407a-aa6c-9a05a35b1c5f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:24.266030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6c5f41a4-ccf5-407a-aa6c-9a05a35b1c5f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:24.267031 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6c5f41a4-ccf5-407a-aa6c-9a05a35b1c5f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:24.267656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6c5f41a4-ccf5-407a-aa6c-9a05a35b1c5f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:24.416786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-6c36444d-84f9-42ab-8b6a-ec4fad8e23d2 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-45083302", "imageRef": "f6b1dddb-2953-41a2-99e3-00aeca441bd9", "flavorRef": "452", "networks": [{"uuid": "5a7bb7ca-64c1-4f04-8b5a-a9887aea00fc"}]}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:03:24.457957 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-6c5f41a4-ccf5-407a-aa6c-9a05a35b1c5f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:24.475249 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-6c5f41a4-ccf5-407a-aa6c-9a05a35b1c5f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:24.481692 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-6c5f41a4-ccf5-407a-aa6c-9a05a35b1c5f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:24.483957 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-6c5f41a4-ccf5-407a-aa6c-9a05a35b1c5f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1721 microversion: 2.20 time: 0.229460 Jun 24 10:03:24.487643 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 166/321] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:24 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:03:24.523040 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.network.neutron [None req-6c36444d-84f9-42ab-8b6a-ec4fad8e23d2 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] validate_networks() for [('5a7bb7ca-64c1-4f04-8b5a-a9887aea00fc', None, None, None, None, None)] {{(pid=124980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:03:25.027843 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-f00c03df-c326-4795-8d9e-d8872cba9cbd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:25.028483 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-f00c03df-c326-4795-8d9e-d8872cba9cbd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:25.043402 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f00c03df-c326-4795-8d9e-d8872cba9cbd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:25.044462 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f00c03df-c326-4795-8d9e-d8872cba9cbd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:25.045935 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f00c03df-c326-4795-8d9e-d8872cba9cbd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:25.046755 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f00c03df-c326-4795-8d9e-d8872cba9cbd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:25.219369 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-6c36444d-84f9-42ab-8b6a-ec4fad8e23d2 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Flavor limits 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:03:25.219820 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-6c36444d-84f9-42ab-8b6a-ec4fad8e23d2 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Image limits 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:03:25.220298 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-6c36444d-84f9-42ab-8b6a-ec4fad8e23d2 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Flavor pref 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:03:25.220718 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-6c36444d-84f9-42ab-8b6a-ec4fad8e23d2 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Image pref 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:03:25.221137 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-6c36444d-84f9-42ab-8b6a-ec4fad8e23d2 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:03:25.232643 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6c36444d-84f9-42ab-8b6a-ec4fad8e23d2 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:25.233462 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6c36444d-84f9-42ab-8b6a-ec4fad8e23d2 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:25.234785 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6c36444d-84f9-42ab-8b6a-ec4fad8e23d2 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:25.235439 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6c36444d-84f9-42ab-8b6a-ec4fad8e23d2 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:25.256814 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-6c36444d-84f9-42ab-8b6a-ec4fad8e23d2 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Getting quotas for project f896de1750fe4c7d9eef897027efb42f. Resources: {'instances', 'cores', 'ram'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:03:25.269523 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-6c36444d-84f9-42ab-8b6a-ec4fad8e23d2 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Getting quotas for user ff0cf4a0b4e04ce79340bac70992bf32 and project f896de1750fe4c7d9eef897027efb42f. Resources: {'instances', 'cores', 'ram'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:03:25.283983 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-6c36444d-84f9-42ab-8b6a-ec4fad8e23d2 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Going to run 1 instances... {{(pid=124980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:03:25.286936 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-6c36444d-84f9-42ab-8b6a-ec4fad8e23d2 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: b7951b2f-c465-46fa-9043-7d7e6f4b259a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6b1dddb-2953-41a2-99e3-00aeca441bd9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:03:25.411454 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-6c36444d-84f9-42ab-8b6a-ec4fad8e23d2 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.001496 Jun 24 10:03:25.412539 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 156/322] 10.222.0.26 () {60 vars in 1146 bytes} [Fri Jun 24 10:03:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 10:03:25.448942 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-ba2a759b-475c-4dd1-b3ab-24fea2e14bcb tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:25.449570 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-ba2a759b-475c-4dd1-b3ab-24fea2e14bcb tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: b7951b2f-c465-46fa-9043-7d7e6f4b259a] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:25.563831 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-ba2a759b-475c-4dd1-b3ab-24fea2e14bcb tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:25.588553 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-ba2a759b-475c-4dd1-b3ab-24fea2e14bcb tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a" status: 200 len: 1212 microversion: 2.1 time: 0.169541 Jun 24 10:03:25.589474 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 157/323] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:25 2022] GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a => generated 1212 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:25.600174 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-e9f29670-3d52-47e5-a256-9d8713f2ddba tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:25.601002 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-e9f29670-3d52-47e5-a256-9d8713f2ddba tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:25.622250 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-f00c03df-c326-4795-8d9e-d8872cba9cbd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:25.628884 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e9f29670-3d52-47e5-a256-9d8713f2ddba tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:25.629167 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e9f29670-3d52-47e5-a256-9d8713f2ddba tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:25.630259 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e9f29670-3d52-47e5-a256-9d8713f2ddba tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:25.631944 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e9f29670-3d52-47e5-a256-9d8713f2ddba tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:25.639432 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-f00c03df-c326-4795-8d9e-d8872cba9cbd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1371 microversion: 2.1 time: 0.615430 Jun 24 10:03:25.651464 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 167/324] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:25 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1371 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:25.926634 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-e9f29670-3d52-47e5-a256-9d8713f2ddba tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:25.937029 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-e9f29670-3d52-47e5-a256-9d8713f2ddba tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:25.938619 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-e9f29670-3d52-47e5-a256-9d8713f2ddba tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:25.939787 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-e9f29670-3d52-47e5-a256-9d8713f2ddba tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1721 microversion: 2.20 time: 0.349381 Jun 24 10:03:25.940399 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 158/325] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:25 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1721 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:03:26.611360 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-3101471c-c835-44c8-b04c-f3a28e0df200 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:26.613173 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-3101471c-c835-44c8-b04c-f3a28e0df200 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: b7951b2f-c465-46fa-9043-7d7e6f4b259a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:26.620818 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3101471c-c835-44c8-b04c-f3a28e0df200 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:26.621616 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3101471c-c835-44c8-b04c-f3a28e0df200 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:26.622612 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3101471c-c835-44c8-b04c-f3a28e0df200 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:26.623270 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3101471c-c835-44c8-b04c-f3a28e0df200 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:26.658432 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-023d70ea-fad1-44f1-8f63-ac9e11f1cc7e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:26.659167 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-023d70ea-fad1-44f1-8f63-ac9e11f1cc7e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:26.667437 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-023d70ea-fad1-44f1-8f63-ac9e11f1cc7e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:26.668178 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-023d70ea-fad1-44f1-8f63-ac9e11f1cc7e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:26.669387 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-023d70ea-fad1-44f1-8f63-ac9e11f1cc7e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:26.670586 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-023d70ea-fad1-44f1-8f63-ac9e11f1cc7e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:26.890424 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-3101471c-c835-44c8-b04c-f3a28e0df200 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:26.898631 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-3101471c-c835-44c8-b04c-f3a28e0df200 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a" status: 200 len: 1216 microversion: 2.1 time: 0.292190 Jun 24 10:03:26.911062 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 168/326] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:26 2022] GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a => generated 1216 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:26.955087 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-39dc92e2-6b90-4f44-a8a3-858045f98a1b req-7cb78fc6-0d88-4f03-917f-a02e014eb6eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c170d532-d8da-4b26-879d-22c7dc180716", "tag": "62ac8ae2-de6d-4539-8e21-9a572eab33d9"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:03:26.968642 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-39dc92e2-6b90-4f44-a8a3-858045f98a1b req-7cb78fc6-0d88-4f03-917f-a02e014eb6eb service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:26.969510 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-39dc92e2-6b90-4f44-a8a3-858045f98a1b req-7cb78fc6-0d88-4f03-917f-a02e014eb6eb service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:26.994541 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-39dc92e2-6b90-4f44-a8a3-858045f98a1b req-7cb78fc6-0d88-4f03-917f-a02e014eb6eb service nova] Creating event network-changed:62ac8ae2-de6d-4539-8e21-9a572eab33d9 for instance c170d532-d8da-4b26-879d-22c7dc180716 on hv-cinder-84327 Jun 24 10:03:27.002135 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-39dc92e2-6b90-4f44-a8a3-858045f98a1b req-7cb78fc6-0d88-4f03-917f-a02e014eb6eb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067455 Jun 24 10:03:27.003419 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 169/327] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:03:27.013534 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-f304040e-58d6-489a-8cbc-5987bc6956cb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:27.014657 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-f304040e-58d6-489a-8cbc-5987bc6956cb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:27.017649 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-023d70ea-fad1-44f1-8f63-ac9e11f1cc7e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:27.023975 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f304040e-58d6-489a-8cbc-5987bc6956cb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:27.024808 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f304040e-58d6-489a-8cbc-5987bc6956cb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:27.025787 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f304040e-58d6-489a-8cbc-5987bc6956cb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:27.025917 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-023d70ea-fad1-44f1-8f63-ac9e11f1cc7e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1371 microversion: 2.1 time: 0.371832 Jun 24 10:03:27.039829 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 159/328] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:26 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1371 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:27.040812 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f304040e-58d6-489a-8cbc-5987bc6956cb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:27.556417 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-f304040e-58d6-489a-8cbc-5987bc6956cb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:27.564893 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-f304040e-58d6-489a-8cbc-5987bc6956cb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:27.566398 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-f304040e-58d6-489a-8cbc-5987bc6956cb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:27.567619 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-f304040e-58d6-489a-8cbc-5987bc6956cb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1721 microversion: 2.20 time: 0.562889 Jun 24 10:03:27.580547 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 170/329] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:27 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1721 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:03:27.648426 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-aa3a036a-f513-4ec7-867e-1b4085c68f32 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:03:27.655649 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-aa3a036a-f513-4ec7-867e-1b4085c68f32 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:27.656363 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-aa3a036a-f513-4ec7-867e-1b4085c68f32 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:27.718338 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-aa3a036a-f513-4ec7-867e-1b4085c68f32 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Going to try to stop instance {{(pid=124980) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 24 10:03:27.861028 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:03:27.916621 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-98729457-ca80-4371-8579-7e80d16118b4 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:27.917142 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-aa3a036a-f513-4ec7-867e-1b4085c68f32 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "POST /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e/action" status: 202 len: 0 microversion: 2.1 time: 0.272492 Jun 24 10:03:27.917830 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-98729457-ca80-4371-8579-7e80d16118b4 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: b7951b2f-c465-46fa-9043-7d7e6f4b259a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:27.921836 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 160/330] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Jun 24 10:03:27 2022] POST /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:03:27.929349 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-98729457-ca80-4371-8579-7e80d16118b4 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:27.944611 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-98729457-ca80-4371-8579-7e80d16118b4 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:27.945606 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-98729457-ca80-4371-8579-7e80d16118b4 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:27.946016 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-98729457-ca80-4371-8579-7e80d16118b4 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:27.960486 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-26509bf0-19b6-45ac-af93-46d10f6aca9f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:27.963446 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-26509bf0-19b6-45ac-af93-46d10f6aca9f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:27.978673 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-26509bf0-19b6-45ac-af93-46d10f6aca9f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:27.979672 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-26509bf0-19b6-45ac-af93-46d10f6aca9f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:27.981311 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-26509bf0-19b6-45ac-af93-46d10f6aca9f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:27.983338 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-26509bf0-19b6-45ac-af93-46d10f6aca9f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:28.191642 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-26509bf0-19b6-45ac-af93-46d10f6aca9f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:28.225354 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-26509bf0-19b6-45ac-af93-46d10f6aca9f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1723 microversion: 2.1 time: 0.291024 Jun 24 10:03:28.241307 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 161/331] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:27 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1723 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:28.250401 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-fedc1c0b-68bb-460d-935b-2675bafb2e91 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:28.254688 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-fedc1c0b-68bb-460d-935b-2675bafb2e91 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:28.264800 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-fedc1c0b-68bb-460d-935b-2675bafb2e91 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:28.265550 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-fedc1c0b-68bb-460d-935b-2675bafb2e91 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:28.266514 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-fedc1c0b-68bb-460d-935b-2675bafb2e91 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:28.267113 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-fedc1c0b-68bb-460d-935b-2675bafb2e91 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:28.281018 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-98729457-ca80-4371-8579-7e80d16118b4 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:28.288788 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-98729457-ca80-4371-8579-7e80d16118b4 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a" status: 200 len: 1264 microversion: 2.1 time: 0.376845 Jun 24 10:03:28.290784 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 171/332] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:27 2022] GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a => generated 1264 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:28.513615 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-fedc1c0b-68bb-460d-935b-2675bafb2e91 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:28.521406 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-fedc1c0b-68bb-460d-935b-2675bafb2e91 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1371 microversion: 2.1 time: 0.278215 Jun 24 10:03:28.532370 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 162/333] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:28 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1371 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:28.586439 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-aaf747a8-0ddc-419c-aa66-606904378ff6 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:28.587089 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-aaf747a8-0ddc-419c-aa66-606904378ff6 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:28.593255 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-aaf747a8-0ddc-419c-aa66-606904378ff6 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:28.593670 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-aaf747a8-0ddc-419c-aa66-606904378ff6 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:28.594504 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-aaf747a8-0ddc-419c-aa66-606904378ff6 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:28.594886 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-aaf747a8-0ddc-419c-aa66-606904378ff6 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:28.838013 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-aaf747a8-0ddc-419c-aa66-606904378ff6 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:28.852699 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-aaf747a8-0ddc-419c-aa66-606904378ff6 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:28.861807 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-aaf747a8-0ddc-419c-aa66-606904378ff6 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:28.869296 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-aaf747a8-0ddc-419c-aa66-606904378ff6 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1721 microversion: 2.20 time: 0.286582 Jun 24 10:03:28.871073 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 172/334] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:28 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1721 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:03:29.246278 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-07d743bc-0148-45a9-9500-6a929f3cff0f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:29.246892 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-07d743bc-0148-45a9-9500-6a929f3cff0f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:29.256747 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-07d743bc-0148-45a9-9500-6a929f3cff0f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:29.257115 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-07d743bc-0148-45a9-9500-6a929f3cff0f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:29.257890 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-07d743bc-0148-45a9-9500-6a929f3cff0f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:29.258347 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-07d743bc-0148-45a9-9500-6a929f3cff0f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:29.312163 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-c4d4e223-9aff-4400-bd6b-b21afa2fbf83 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:29.313042 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-c4d4e223-9aff-4400-bd6b-b21afa2fbf83 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: b7951b2f-c465-46fa-9043-7d7e6f4b259a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:29.326871 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c4d4e223-9aff-4400-bd6b-b21afa2fbf83 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:29.329623 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c4d4e223-9aff-4400-bd6b-b21afa2fbf83 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:29.330800 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c4d4e223-9aff-4400-bd6b-b21afa2fbf83 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:29.331228 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c4d4e223-9aff-4400-bd6b-b21afa2fbf83 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:29.460985 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-07d743bc-0148-45a9-9500-6a929f3cff0f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:29.470064 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-07d743bc-0148-45a9-9500-6a929f3cff0f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1723 microversion: 2.1 time: 0.227638 Jun 24 10:03:29.470956 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 163/335] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:29 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:29.538779 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-58374201-c51c-4851-a076-c8554b4a0f76 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:29.539398 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-58374201-c51c-4851-a076-c8554b4a0f76 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:29.548097 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-58374201-c51c-4851-a076-c8554b4a0f76 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:29.550976 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-58374201-c51c-4851-a076-c8554b4a0f76 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:29.552519 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-58374201-c51c-4851-a076-c8554b4a0f76 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:29.553114 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-58374201-c51c-4851-a076-c8554b4a0f76 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:29.630746 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-c4d4e223-9aff-4400-bd6b-b21afa2fbf83 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:29.641236 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-c4d4e223-9aff-4400-bd6b-b21afa2fbf83 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a" status: 200 len: 1312 microversion: 2.1 time: 0.333068 Jun 24 10:03:29.643755 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 173/336] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:29 2022] GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a => generated 1312 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:29.726644 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-58374201-c51c-4851-a076-c8554b4a0f76 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:29.734320 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-58374201-c51c-4851-a076-c8554b4a0f76 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1371 microversion: 2.1 time: 0.199287 Jun 24 10:03:29.734894 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 164/337] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:29 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:03:29.888433 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-559c0bf9-ddda-4b7d-acfa-74858c0e996c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:29.889167 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-559c0bf9-ddda-4b7d-acfa-74858c0e996c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:29.898016 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-559c0bf9-ddda-4b7d-acfa-74858c0e996c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:29.898473 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-559c0bf9-ddda-4b7d-acfa-74858c0e996c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:29.899291 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-559c0bf9-ddda-4b7d-acfa-74858c0e996c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:29.899725 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-559c0bf9-ddda-4b7d-acfa-74858c0e996c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:30.199396 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell0:SELECT=2 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:03:30.218224 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell0:SELECT=10 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:03:30.292907 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-559c0bf9-ddda-4b7d-acfa-74858c0e996c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:30.301647 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-559c0bf9-ddda-4b7d-acfa-74858c0e996c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:30.303161 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-559c0bf9-ddda-4b7d-acfa-74858c0e996c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:30.304371 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-559c0bf9-ddda-4b7d-acfa-74858c0e996c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1721 microversion: 2.20 time: 0.419855 Jun 24 10:03:30.304930 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 174/338] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:29 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1721 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:03:30.492972 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-82e275ec-c8d7-4e78-8a35-ab28cad142cc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:30.493591 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-82e275ec-c8d7-4e78-8a35-ab28cad142cc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:30.507078 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-82e275ec-c8d7-4e78-8a35-ab28cad142cc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:30.507872 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-82e275ec-c8d7-4e78-8a35-ab28cad142cc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:30.509157 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-82e275ec-c8d7-4e78-8a35-ab28cad142cc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:30.509808 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-82e275ec-c8d7-4e78-8a35-ab28cad142cc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:30.658864 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-92bf3cbf-0028-420b-bf01-f5fa9f3eee51 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:30.659893 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-92bf3cbf-0028-420b-bf01-f5fa9f3eee51 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: b7951b2f-c465-46fa-9043-7d7e6f4b259a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:30.668063 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-92bf3cbf-0028-420b-bf01-f5fa9f3eee51 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:30.668582 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-92bf3cbf-0028-420b-bf01-f5fa9f3eee51 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:30.669449 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-92bf3cbf-0028-420b-bf01-f5fa9f3eee51 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:30.670416 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-92bf3cbf-0028-420b-bf01-f5fa9f3eee51 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:30.751878 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-82e275ec-c8d7-4e78-8a35-ab28cad142cc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:30.767763 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-82e275ec-c8d7-4e78-8a35-ab28cad142cc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1723 microversion: 2.1 time: 0.278720 Jun 24 10:03:30.775435 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 165/339] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:30 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:30.780811 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-166d150f-f9a3-4ca2-aae3-78f73ecb396e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:30.783930 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-166d150f-f9a3-4ca2-aae3-78f73ecb396e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:30.797406 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-166d150f-f9a3-4ca2-aae3-78f73ecb396e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:30.801812 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-166d150f-f9a3-4ca2-aae3-78f73ecb396e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:30.801812 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-166d150f-f9a3-4ca2-aae3-78f73ecb396e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:30.801812 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-166d150f-f9a3-4ca2-aae3-78f73ecb396e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:31.048893 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-92bf3cbf-0028-420b-bf01-f5fa9f3eee51 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:31.064907 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-92bf3cbf-0028-420b-bf01-f5fa9f3eee51 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a" status: 200 len: 1312 microversion: 2.1 time: 0.409612 Jun 24 10:03:31.076797 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 175/340] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:30 2022] GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a => generated 1312 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:03:31.076797 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-b4253421-6b46-4b4f-8445-f8460e6fac03 req-072eec3e-01ba-417b-850a-a0be1f8b3156 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7951b2f-c465-46fa-9043-7d7e6f4b259a", "tag": "7a2487cd-65e1-440a-993c-799a4156c918"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:03:31.097150 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-b4253421-6b46-4b4f-8445-f8460e6fac03 req-072eec3e-01ba-417b-850a-a0be1f8b3156 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:31.097746 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-b4253421-6b46-4b4f-8445-f8460e6fac03 req-072eec3e-01ba-417b-850a-a0be1f8b3156 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:31.127951 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-166d150f-f9a3-4ca2-aae3-78f73ecb396e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:31.138752 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-166d150f-f9a3-4ca2-aae3-78f73ecb396e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1371 microversion: 2.1 time: 0.361223 Jun 24 10:03:31.143680 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 166/341] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:30 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1371 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:31.157964 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-b4253421-6b46-4b4f-8445-f8460e6fac03 req-072eec3e-01ba-417b-850a-a0be1f8b3156 service nova] Creating event network-changed:7a2487cd-65e1-440a-993c-799a4156c918 for instance b7951b2f-c465-46fa-9043-7d7e6f4b259a on hv-cinder-84327 Jun 24 10:03:31.167000 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-b4253421-6b46-4b4f-8445-f8460e6fac03 req-072eec3e-01ba-417b-850a-a0be1f8b3156 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097925 Jun 24 10:03:31.170602 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 176/342] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:03:31.323594 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-33c67905-88c3-4cd0-bde5-666eb5961d90 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:31.324418 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-33c67905-88c3-4cd0-bde5-666eb5961d90 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:31.330333 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-33c67905-88c3-4cd0-bde5-666eb5961d90 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:31.330783 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-33c67905-88c3-4cd0-bde5-666eb5961d90 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:31.332068 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-33c67905-88c3-4cd0-bde5-666eb5961d90 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:31.332993 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-33c67905-88c3-4cd0-bde5-666eb5961d90 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:31.568778 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-33c67905-88c3-4cd0-bde5-666eb5961d90 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:31.576185 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-33c67905-88c3-4cd0-bde5-666eb5961d90 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:31.577981 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-33c67905-88c3-4cd0-bde5-666eb5961d90 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:31.579587 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-33c67905-88c3-4cd0-bde5-666eb5961d90 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1742 microversion: 2.20 time: 0.260044 Jun 24 10:03:31.591357 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 167/343] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:31 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1742 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:03:31.785055 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-ae7b9216-65de-49e5-803d-d54f58b92122 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:31.786788 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-ae7b9216-65de-49e5-803d-d54f58b92122 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:31.823306 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ae7b9216-65de-49e5-803d-d54f58b92122 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:31.824048 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ae7b9216-65de-49e5-803d-d54f58b92122 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:31.826695 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ae7b9216-65de-49e5-803d-d54f58b92122 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:31.826695 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ae7b9216-65de-49e5-803d-d54f58b92122 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:32.071522 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-ae7b9216-65de-49e5-803d-d54f58b92122 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:32.075439 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=100 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:03:32.082950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-ae7b9216-65de-49e5-803d-d54f58b92122 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1723 microversion: 2.1 time: 0.302211 Jun 24 10:03:32.083569 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 177/344] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:31 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1723 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:32.089281 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-6ae437eb-755d-4d70-8039-0630d42e92d7 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:32.090217 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-6ae437eb-755d-4d70-8039-0630d42e92d7 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: b7951b2f-c465-46fa-9043-7d7e6f4b259a] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:32.099139 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6ae437eb-755d-4d70-8039-0630d42e92d7 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:32.099803 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6ae437eb-755d-4d70-8039-0630d42e92d7 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:32.100907 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6ae437eb-755d-4d70-8039-0630d42e92d7 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:32.101493 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6ae437eb-755d-4d70-8039-0630d42e92d7 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:32.155974 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-7f03bcb5-a387-410c-b566-67d8cd4db509 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:32.156332 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-7f03bcb5-a387-410c-b566-67d8cd4db509 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:32.163634 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7f03bcb5-a387-410c-b566-67d8cd4db509 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:32.164100 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7f03bcb5-a387-410c-b566-67d8cd4db509 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:32.166768 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7f03bcb5-a387-410c-b566-67d8cd4db509 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:32.166768 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7f03bcb5-a387-410c-b566-67d8cd4db509 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:32.408229 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-6ae437eb-755d-4d70-8039-0630d42e92d7 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:32.416743 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-6ae437eb-755d-4d70-8039-0630d42e92d7 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a" status: 200 len: 1312 microversion: 2.1 time: 0.335880 Jun 24 10:03:32.429405 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 168/345] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:32 2022] GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a => generated 1312 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:03:32.453820 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-7f03bcb5-a387-410c-b566-67d8cd4db509 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:32.463541 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-7f03bcb5-a387-410c-b566-67d8cd4db509 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1371 microversion: 2.1 time: 0.311779 Jun 24 10:03:32.466787 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 178/346] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:32 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1371 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:03:32.597147 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-8b35da4f-f006-4757-a776-4920c701c9fe tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:32.598304 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-8b35da4f-f006-4757-a776-4920c701c9fe tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:32.605721 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8b35da4f-f006-4757-a776-4920c701c9fe tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:32.606373 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8b35da4f-f006-4757-a776-4920c701c9fe tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:32.607317 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8b35da4f-f006-4757-a776-4920c701c9fe tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:32.607910 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8b35da4f-f006-4757-a776-4920c701c9fe tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:32.817272 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-8b35da4f-f006-4757-a776-4920c701c9fe tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:32.825898 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-8b35da4f-f006-4757-a776-4920c701c9fe tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:32.827405 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-8b35da4f-f006-4757-a776-4920c701c9fe tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:32.828600 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-8b35da4f-f006-4757-a776-4920c701c9fe tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1742 microversion: 2.20 time: 0.235410 Jun 24 10:03:32.829157 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 169/347] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:32 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1742 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:03:33.101560 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-b9e41a0c-8d3f-4275-ab84-09dbc5632380 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:33.102812 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-b9e41a0c-8d3f-4275-ab84-09dbc5632380 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:33.112077 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b9e41a0c-8d3f-4275-ab84-09dbc5632380 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:33.112551 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b9e41a0c-8d3f-4275-ab84-09dbc5632380 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:33.113433 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b9e41a0c-8d3f-4275-ab84-09dbc5632380 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:33.114014 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b9e41a0c-8d3f-4275-ab84-09dbc5632380 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:33.333527 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-b9e41a0c-8d3f-4275-ab84-09dbc5632380 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:33.342484 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-b9e41a0c-8d3f-4275-ab84-09dbc5632380 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1723 microversion: 2.1 time: 0.245636 Jun 24 10:03:33.343133 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 179/348] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:33 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:33.439502 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-1b011892-f8e0-4f85-8b1a-5348723ee554 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:33.440296 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-1b011892-f8e0-4f85-8b1a-5348723ee554 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: b7951b2f-c465-46fa-9043-7d7e6f4b259a] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:33.448760 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1b011892-f8e0-4f85-8b1a-5348723ee554 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:33.449480 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1b011892-f8e0-4f85-8b1a-5348723ee554 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:33.450768 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1b011892-f8e0-4f85-8b1a-5348723ee554 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:33.451515 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1b011892-f8e0-4f85-8b1a-5348723ee554 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:33.483987 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-b16f6f3a-798c-40e3-9fd1-fc2309cce931 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:33.484654 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-b16f6f3a-798c-40e3-9fd1-fc2309cce931 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:33.491295 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b16f6f3a-798c-40e3-9fd1-fc2309cce931 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:33.491833 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b16f6f3a-798c-40e3-9fd1-fc2309cce931 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:33.492873 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b16f6f3a-798c-40e3-9fd1-fc2309cce931 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:33.493377 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b16f6f3a-798c-40e3-9fd1-fc2309cce931 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:33.628783 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-1b011892-f8e0-4f85-8b1a-5348723ee554 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:33.637651 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-1b011892-f8e0-4f85-8b1a-5348723ee554 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a" status: 200 len: 1312 microversion: 2.1 time: 0.202796 Jun 24 10:03:33.647904 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 170/349] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:33 2022] GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a => generated 1312 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:33.712812 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-b16f6f3a-798c-40e3-9fd1-fc2309cce931 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:33.721980 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-b16f6f3a-798c-40e3-9fd1-fc2309cce931 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1371 microversion: 2.1 time: 0.242078 Jun 24 10:03:33.724764 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 180/350] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:33 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:03:33.847573 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-0bd00175-a208-4952-978a-2f2aeae2ff76 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:33.848477 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-0bd00175-a208-4952-978a-2f2aeae2ff76 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:33.858695 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0bd00175-a208-4952-978a-2f2aeae2ff76 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:33.859760 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0bd00175-a208-4952-978a-2f2aeae2ff76 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:33.860877 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0bd00175-a208-4952-978a-2f2aeae2ff76 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:33.861502 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0bd00175-a208-4952-978a-2f2aeae2ff76 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:34.096095 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-0bd00175-a208-4952-978a-2f2aeae2ff76 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:34.108369 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-0bd00175-a208-4952-978a-2f2aeae2ff76 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:34.110821 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-0bd00175-a208-4952-978a-2f2aeae2ff76 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:34.113015 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-0bd00175-a208-4952-978a-2f2aeae2ff76 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1742 microversion: 2.20 time: 0.269442 Jun 24 10:03:34.114126 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 171/351] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:33 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1742 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:03:34.360225 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-30109792-38f7-4c41-ba9b-c48ecf1d7c83 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:34.360841 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-30109792-38f7-4c41-ba9b-c48ecf1d7c83 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:34.368007 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-30109792-38f7-4c41-ba9b-c48ecf1d7c83 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:34.368818 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-30109792-38f7-4c41-ba9b-c48ecf1d7c83 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:34.369829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-30109792-38f7-4c41-ba9b-c48ecf1d7c83 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:34.370709 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-30109792-38f7-4c41-ba9b-c48ecf1d7c83 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:34.527955 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-30109792-38f7-4c41-ba9b-c48ecf1d7c83 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:34.554334 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-30109792-38f7-4c41-ba9b-c48ecf1d7c83 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1723 microversion: 2.1 time: 0.198058 Jun 24 10:03:34.556462 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 181/352] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:34 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:34.655650 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-3388577c-cb83-4893-a678-b10696afe7d2 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:34.656767 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-3388577c-cb83-4893-a678-b10696afe7d2 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: b7951b2f-c465-46fa-9043-7d7e6f4b259a] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:34.669465 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3388577c-cb83-4893-a678-b10696afe7d2 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:34.670844 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3388577c-cb83-4893-a678-b10696afe7d2 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:34.676000 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3388577c-cb83-4893-a678-b10696afe7d2 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:34.676617 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3388577c-cb83-4893-a678-b10696afe7d2 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:34.745436 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-d2da1a2c-8a98-4c76-bbe1-f4bb2fed3db7 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:34.746126 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-d2da1a2c-8a98-4c76-bbe1-f4bb2fed3db7 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:34.758922 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d2da1a2c-8a98-4c76-bbe1-f4bb2fed3db7 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:34.760065 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d2da1a2c-8a98-4c76-bbe1-f4bb2fed3db7 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:34.760828 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d2da1a2c-8a98-4c76-bbe1-f4bb2fed3db7 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:34.761369 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d2da1a2c-8a98-4c76-bbe1-f4bb2fed3db7 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:34.943305 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-3388577c-cb83-4893-a678-b10696afe7d2 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:34.953269 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-3388577c-cb83-4893-a678-b10696afe7d2 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a" status: 200 len: 1312 microversion: 2.1 time: 0.301551 Jun 24 10:03:34.964329 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 172/353] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:34 2022] GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a => generated 1312 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:35.134230 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-dc1c22c2-c725-4a1d-988e-3a2a3f247293 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:35.135484 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-dc1c22c2-c725-4a1d-988e-3a2a3f247293 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:35.148153 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-dc1c22c2-c725-4a1d-988e-3a2a3f247293 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:35.149388 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-dc1c22c2-c725-4a1d-988e-3a2a3f247293 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:35.150644 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-dc1c22c2-c725-4a1d-988e-3a2a3f247293 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:35.151091 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-dc1c22c2-c725-4a1d-988e-3a2a3f247293 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:35.156946 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d2da1a2c-8a98-4c76-bbe1-f4bb2fed3db7 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:35.173243 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-d2da1a2c-8a98-4c76-bbe1-f4bb2fed3db7 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1371 microversion: 2.1 time: 0.436953 Jun 24 10:03:35.184669 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 182/354] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:34 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1371 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:03:35.246893 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell0:SELECT=2 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:03:35.308601 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-72432602-79da-4f08-bf50-4c0f1537ea05 req-0ed8397d-495c-45b3-b97a-dc0cc7ed0b2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c170d532-d8da-4b26-879d-22c7dc180716", "name": "network-vif-plugged", "status": "completed", "tag": "62ac8ae2-de6d-4539-8e21-9a572eab33d9"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:03:35.317278 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-72432602-79da-4f08-bf50-4c0f1537ea05 req-0ed8397d-495c-45b3-b97a-dc0cc7ed0b2c service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:35.318119 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-72432602-79da-4f08-bf50-4c0f1537ea05 req-0ed8397d-495c-45b3-b97a-dc0cc7ed0b2c service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:35.346740 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-72432602-79da-4f08-bf50-4c0f1537ea05 req-0ed8397d-495c-45b3-b97a-dc0cc7ed0b2c service nova] Creating event network-vif-plugged:62ac8ae2-de6d-4539-8e21-9a572eab33d9 for instance c170d532-d8da-4b26-879d-22c7dc180716 on hv-cinder-84327 Jun 24 10:03:35.353637 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-72432602-79da-4f08-bf50-4c0f1537ea05 req-0ed8397d-495c-45b3-b97a-dc0cc7ed0b2c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048653 Jun 24 10:03:35.355373 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 183/355] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:03:35.369106 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-dc1c22c2-c725-4a1d-988e-3a2a3f247293 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:35.377839 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-dc1c22c2-c725-4a1d-988e-3a2a3f247293 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:35.379344 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-dc1c22c2-c725-4a1d-988e-3a2a3f247293 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:35.380550 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-dc1c22c2-c725-4a1d-988e-3a2a3f247293 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1742 microversion: 2.20 time: 0.252712 Jun 24 10:03:35.381253 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 173/356] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:35 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1742 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:03:35.574839 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-d10b32bf-9498-4451-b7c7-1d40d5e480c6 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:35.584145 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-d10b32bf-9498-4451-b7c7-1d40d5e480c6 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:35.624385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d10b32bf-9498-4451-b7c7-1d40d5e480c6 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:35.625364 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d10b32bf-9498-4451-b7c7-1d40d5e480c6 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:35.626382 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d10b32bf-9498-4451-b7c7-1d40d5e480c6 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:35.627180 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d10b32bf-9498-4451-b7c7-1d40d5e480c6 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:35.948433 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d10b32bf-9498-4451-b7c7-1d40d5e480c6 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:35.962451 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-d10b32bf-9498-4451-b7c7-1d40d5e480c6 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1723 microversion: 2.1 time: 0.393921 Jun 24 10:03:35.963607 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 184/357] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:35 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1723 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:35.970801 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-4ca93559-d877-4491-944b-9ed5980c5993 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:35.971417 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-4ca93559-d877-4491-944b-9ed5980c5993 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: b7951b2f-c465-46fa-9043-7d7e6f4b259a] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:35.973516 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell0:SELECT=10 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:03:35.986461 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4ca93559-d877-4491-944b-9ed5980c5993 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:35.986929 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4ca93559-d877-4491-944b-9ed5980c5993 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:35.987723 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4ca93559-d877-4491-944b-9ed5980c5993 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:35.988186 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4ca93559-d877-4491-944b-9ed5980c5993 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:36.195102 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-dec5f71f-3dc7-4249-86a3-49ef16e158b8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:36.196834 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-dec5f71f-3dc7-4249-86a3-49ef16e158b8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:36.201463 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:03:36.217428 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-dec5f71f-3dc7-4249-86a3-49ef16e158b8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:36.222772 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-dec5f71f-3dc7-4249-86a3-49ef16e158b8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:36.222772 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-dec5f71f-3dc7-4249-86a3-49ef16e158b8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:36.222772 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-dec5f71f-3dc7-4249-86a3-49ef16e158b8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:36.283928 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-4ca93559-d877-4491-944b-9ed5980c5993 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:36.294027 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-4ca93559-d877-4491-944b-9ed5980c5993 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a" status: 200 len: 1312 microversion: 2.1 time: 0.327073 Jun 24 10:03:36.302006 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 174/358] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:35 2022] GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a => generated 1312 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:36.399106 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-25d7767d-9824-4cc5-a538-cc8cfee102ef tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:36.400069 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-25d7767d-9824-4cc5-a538-cc8cfee102ef tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:36.413542 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-25d7767d-9824-4cc5-a538-cc8cfee102ef tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:36.415711 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-25d7767d-9824-4cc5-a538-cc8cfee102ef tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:36.416829 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-25d7767d-9824-4cc5-a538-cc8cfee102ef tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:36.418697 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-25d7767d-9824-4cc5-a538-cc8cfee102ef tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:36.622394 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-dec5f71f-3dc7-4249-86a3-49ef16e158b8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:36.634504 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-dec5f71f-3dc7-4249-86a3-49ef16e158b8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1371 microversion: 2.1 time: 0.445578 Jun 24 10:03:36.636997 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 185/359] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:36 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1371 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:03:36.706225 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-25d7767d-9824-4cc5-a538-cc8cfee102ef tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:36.711627 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-25d7767d-9824-4cc5-a538-cc8cfee102ef tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:36.716984 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-25d7767d-9824-4cc5-a538-cc8cfee102ef tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:36.718294 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-25d7767d-9824-4cc5-a538-cc8cfee102ef tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1742 microversion: 2.20 time: 0.323465 Jun 24 10:03:36.718839 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 175/360] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:36 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1742 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:03:36.983013 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-55185214-00a4-4020-95f4-43dfef39d836 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:36.983804 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-55185214-00a4-4020-95f4-43dfef39d836 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:36.990393 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-55185214-00a4-4020-95f4-43dfef39d836 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:36.990988 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-55185214-00a4-4020-95f4-43dfef39d836 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:36.991775 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-55185214-00a4-4020-95f4-43dfef39d836 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:36.992247 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-55185214-00a4-4020-95f4-43dfef39d836 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:37.289036 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-55185214-00a4-4020-95f4-43dfef39d836 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:37.306177 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-55185214-00a4-4020-95f4-43dfef39d836 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1723 microversion: 2.1 time: 0.325412 Jun 24 10:03:37.306177 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 186/361] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:36 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1723 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:37.316998 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-1254f045-a026-45ae-b31f-a09d6dacb00e tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:37.317781 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-1254f045-a026-45ae-b31f-a09d6dacb00e tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: b7951b2f-c465-46fa-9043-7d7e6f4b259a] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:37.321923 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:03:37.331472 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1254f045-a026-45ae-b31f-a09d6dacb00e tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:37.337480 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1254f045-a026-45ae-b31f-a09d6dacb00e tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:37.337480 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1254f045-a026-45ae-b31f-a09d6dacb00e tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:37.337480 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1254f045-a026-45ae-b31f-a09d6dacb00e tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:37.547062 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-1254f045-a026-45ae-b31f-a09d6dacb00e tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:37.556338 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-1254f045-a026-45ae-b31f-a09d6dacb00e tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a" status: 200 len: 1312 microversion: 2.1 time: 0.242862 Jun 24 10:03:37.572768 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 176/362] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:37 2022] GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a => generated 1312 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:37.653305 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-505bf9be-c20f-4d0e-b1af-80de31852865 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:37.653922 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-505bf9be-c20f-4d0e-b1af-80de31852865 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:37.667993 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-505bf9be-c20f-4d0e-b1af-80de31852865 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:37.668488 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-505bf9be-c20f-4d0e-b1af-80de31852865 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:37.669428 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-505bf9be-c20f-4d0e-b1af-80de31852865 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:37.669804 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-505bf9be-c20f-4d0e-b1af-80de31852865 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:37.738570 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-d908ddc5-7e84-41be-b42b-501168658e88 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:37.739485 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-d908ddc5-7e84-41be-b42b-501168658e88 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:37.750333 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d908ddc5-7e84-41be-b42b-501168658e88 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:37.750969 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d908ddc5-7e84-41be-b42b-501168658e88 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:37.753270 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d908ddc5-7e84-41be-b42b-501168658e88 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:37.754879 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d908ddc5-7e84-41be-b42b-501168658e88 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:37.815975 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=100 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:03:38.011222 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d908ddc5-7e84-41be-b42b-501168658e88 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:38.026684 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d908ddc5-7e84-41be-b42b-501168658e88 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:38.029127 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d908ddc5-7e84-41be-b42b-501168658e88 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:38.031885 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-505bf9be-c20f-4d0e-b1af-80de31852865 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:38.036173 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-d908ddc5-7e84-41be-b42b-501168658e88 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1742 microversion: 2.20 time: 0.302893 Jun 24 10:03:38.042092 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 177/363] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:37 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1742 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:03:38.067969 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-505bf9be-c20f-4d0e-b1af-80de31852865 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1371 microversion: 2.1 time: 0.405683 Jun 24 10:03:38.069764 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 187/364] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:37 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1371 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:38.324158 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-64c6945b-2670-43a3-81f0-ed4dc8359520 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:38.324893 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-64c6945b-2670-43a3-81f0-ed4dc8359520 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:38.335996 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-64c6945b-2670-43a3-81f0-ed4dc8359520 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:38.336839 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-64c6945b-2670-43a3-81f0-ed4dc8359520 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:38.338547 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-64c6945b-2670-43a3-81f0-ed4dc8359520 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:38.339519 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-64c6945b-2670-43a3-81f0-ed4dc8359520 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:38.510895 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-64c6945b-2670-43a3-81f0-ed4dc8359520 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:38.522573 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-64c6945b-2670-43a3-81f0-ed4dc8359520 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1723 microversion: 2.1 time: 0.202992 Jun 24 10:03:38.532693 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 178/365] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:38 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:38.597022 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-46480130-01f0-4f57-9dc9-1585edafee93 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:38.600287 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-46480130-01f0-4f57-9dc9-1585edafee93 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: b7951b2f-c465-46fa-9043-7d7e6f4b259a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:38.630700 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-46480130-01f0-4f57-9dc9-1585edafee93 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:38.631919 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-46480130-01f0-4f57-9dc9-1585edafee93 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:38.636193 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-46480130-01f0-4f57-9dc9-1585edafee93 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:38.638479 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-46480130-01f0-4f57-9dc9-1585edafee93 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:39.061350 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-ba9c0ef8-2704-4974-820f-f1a5641f9d35 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:39.062548 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-ba9c0ef8-2704-4974-820f-f1a5641f9d35 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:39.071055 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-46480130-01f0-4f57-9dc9-1585edafee93 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:39.075552 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ba9c0ef8-2704-4974-820f-f1a5641f9d35 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:39.078940 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ba9c0ef8-2704-4974-820f-f1a5641f9d35 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:39.078940 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ba9c0ef8-2704-4974-820f-f1a5641f9d35 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:39.078940 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ba9c0ef8-2704-4974-820f-f1a5641f9d35 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:39.083122 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-46480130-01f0-4f57-9dc9-1585edafee93 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a" status: 200 len: 1312 microversion: 2.1 time: 0.506474 Jun 24 10:03:39.090204 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 188/366] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:38 2022] GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a => generated 1312 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:39.112793 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-99f57257-ba29-42a8-b401-ebb3505fd044 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:39.117371 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-99f57257-ba29-42a8-b401-ebb3505fd044 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:39.132753 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-99f57257-ba29-42a8-b401-ebb3505fd044 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:39.133743 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-99f57257-ba29-42a8-b401-ebb3505fd044 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:39.134532 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-99f57257-ba29-42a8-b401-ebb3505fd044 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:39.135030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-99f57257-ba29-42a8-b401-ebb3505fd044 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:39.332476 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-ba9c0ef8-2704-4974-820f-f1a5641f9d35 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:39.342764 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-ba9c0ef8-2704-4974-820f-f1a5641f9d35 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:39.345946 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-ba9c0ef8-2704-4974-820f-f1a5641f9d35 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:39.348248 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-ba9c0ef8-2704-4974-820f-f1a5641f9d35 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1742 microversion: 2.20 time: 0.293096 Jun 24 10:03:39.352527 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 179/367] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:39 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1742 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:03:39.374139 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-99f57257-ba29-42a8-b401-ebb3505fd044 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:39.382584 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-99f57257-ba29-42a8-b401-ebb3505fd044 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1371 microversion: 2.1 time: 0.282549 Jun 24 10:03:39.406282 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 189/368] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:39 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1371 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:39.543964 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-1f89685a-0aa2-4683-8aba-c4dcab4f5405 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:39.544777 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-1f89685a-0aa2-4683-8aba-c4dcab4f5405 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:39.557908 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1f89685a-0aa2-4683-8aba-c4dcab4f5405 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:39.561836 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1f89685a-0aa2-4683-8aba-c4dcab4f5405 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:39.563304 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1f89685a-0aa2-4683-8aba-c4dcab4f5405 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:39.564024 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1f89685a-0aa2-4683-8aba-c4dcab4f5405 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:39.728223 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-1f89685a-0aa2-4683-8aba-c4dcab4f5405 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:39.738168 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-1f89685a-0aa2-4683-8aba-c4dcab4f5405 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1723 microversion: 2.1 time: 0.201950 Jun 24 10:03:39.749262 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 180/369] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:39 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:40.111444 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-b2d6f034-7ead-4ea6-9ac6-0fa84b00bca3 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:40.112882 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-b2d6f034-7ead-4ea6-9ac6-0fa84b00bca3 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: b7951b2f-c465-46fa-9043-7d7e6f4b259a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:40.125721 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b2d6f034-7ead-4ea6-9ac6-0fa84b00bca3 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:40.127520 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b2d6f034-7ead-4ea6-9ac6-0fa84b00bca3 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:40.128732 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b2d6f034-7ead-4ea6-9ac6-0fa84b00bca3 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:40.129392 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b2d6f034-7ead-4ea6-9ac6-0fa84b00bca3 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:40.368585 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-c9d10025-9d90-4bfd-ae09-00c11be526ff tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:40.370255 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-c9d10025-9d90-4bfd-ae09-00c11be526ff tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:40.377734 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c9d10025-9d90-4bfd-ae09-00c11be526ff tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:40.378754 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c9d10025-9d90-4bfd-ae09-00c11be526ff tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:40.379827 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c9d10025-9d90-4bfd-ae09-00c11be526ff tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:40.380582 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c9d10025-9d90-4bfd-ae09-00c11be526ff tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:40.421358 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-b2d6f034-7ead-4ea6-9ac6-0fa84b00bca3 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:40.433624 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-b2d6f034-7ead-4ea6-9ac6-0fa84b00bca3 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a" status: 200 len: 1312 microversion: 2.1 time: 0.326839 Jun 24 10:03:40.434787 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 190/370] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:40 2022] GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a => generated 1312 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:40.447285 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-c7b2b8f3-bf46-4f0b-ba90-f37ff06d7c34 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:40.447921 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-c7b2b8f3-bf46-4f0b-ba90-f37ff06d7c34 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:40.454943 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c7b2b8f3-bf46-4f0b-ba90-f37ff06d7c34 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:40.455630 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c7b2b8f3-bf46-4f0b-ba90-f37ff06d7c34 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:40.457786 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c7b2b8f3-bf46-4f0b-ba90-f37ff06d7c34 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:40.457786 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c7b2b8f3-bf46-4f0b-ba90-f37ff06d7c34 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:40.547600 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-c9d10025-9d90-4bfd-ae09-00c11be526ff tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:40.557100 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-c9d10025-9d90-4bfd-ae09-00c11be526ff tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:40.558780 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-c9d10025-9d90-4bfd-ae09-00c11be526ff tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:40.560072 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-c9d10025-9d90-4bfd-ae09-00c11be526ff tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1737 microversion: 2.20 time: 0.197099 Jun 24 10:03:40.560858 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 181/371] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:40 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1737 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:03:40.757842 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-34938513-942a-4e42-80c7-768d67218733 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:40.767775 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-34938513-942a-4e42-80c7-768d67218733 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:40.771778 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-c7b2b8f3-bf46-4f0b-ba90-f37ff06d7c34 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:40.776207 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-34938513-942a-4e42-80c7-768d67218733 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:40.780800 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-34938513-942a-4e42-80c7-768d67218733 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:40.781675 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-34938513-942a-4e42-80c7-768d67218733 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:40.786090 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-c7b2b8f3-bf46-4f0b-ba90-f37ff06d7c34 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1371 microversion: 2.1 time: 0.350393 Jun 24 10:03:40.786438 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-34938513-942a-4e42-80c7-768d67218733 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:40.787211 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 191/372] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:40 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1371 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:40.996764 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-34938513-942a-4e42-80c7-768d67218733 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:41.006535 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-34938513-942a-4e42-80c7-768d67218733 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1723 microversion: 2.1 time: 0.255138 Jun 24 10:03:41.007929 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 182/373] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:40 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:41.455792 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-55731d0c-ba68-464f-af12-595d934212a0 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:41.456443 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-55731d0c-ba68-464f-af12-595d934212a0 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: b7951b2f-c465-46fa-9043-7d7e6f4b259a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:41.473942 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-55731d0c-ba68-464f-af12-595d934212a0 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:41.474404 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-55731d0c-ba68-464f-af12-595d934212a0 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:41.475294 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-55731d0c-ba68-464f-af12-595d934212a0 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:41.475890 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-55731d0c-ba68-464f-af12-595d934212a0 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:41.579855 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-30e27909-afe1-4a0d-b1e6-04e416fc4d84 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:41.580659 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-30e27909-afe1-4a0d-b1e6-04e416fc4d84 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:41.601267 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-30e27909-afe1-4a0d-b1e6-04e416fc4d84 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:41.601999 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-30e27909-afe1-4a0d-b1e6-04e416fc4d84 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:41.604551 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-30e27909-afe1-4a0d-b1e6-04e416fc4d84 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:41.605165 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-30e27909-afe1-4a0d-b1e6-04e416fc4d84 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:41.764037 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-55731d0c-ba68-464f-af12-595d934212a0 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:41.775367 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-55731d0c-ba68-464f-af12-595d934212a0 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a" status: 200 len: 1312 microversion: 2.1 time: 0.324832 Jun 24 10:03:41.776197 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 192/374] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:41 2022] GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a => generated 1312 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:41.803017 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-b45ab2b7-e02b-4128-8c6a-3c7ba62a2180 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:41.803743 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-b45ab2b7-e02b-4128-8c6a-3c7ba62a2180 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:41.812432 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b45ab2b7-e02b-4128-8c6a-3c7ba62a2180 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:41.813184 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b45ab2b7-e02b-4128-8c6a-3c7ba62a2180 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:41.815014 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b45ab2b7-e02b-4128-8c6a-3c7ba62a2180 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:41.815669 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b45ab2b7-e02b-4128-8c6a-3c7ba62a2180 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:41.949040 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-30e27909-afe1-4a0d-b1e6-04e416fc4d84 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:41.958831 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-30e27909-afe1-4a0d-b1e6-04e416fc4d84 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:41.960396 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-30e27909-afe1-4a0d-b1e6-04e416fc4d84 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:41.961668 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-30e27909-afe1-4a0d-b1e6-04e416fc4d84 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1737 microversion: 2.20 time: 0.386026 Jun 24 10:03:41.964902 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 183/375] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:41 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1737 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:03:42.035788 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-f574bd2b-9391-4a46-b85c-7557748f258c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:42.037192 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-f574bd2b-9391-4a46-b85c-7557748f258c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:42.056080 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f574bd2b-9391-4a46-b85c-7557748f258c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:42.056586 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f574bd2b-9391-4a46-b85c-7557748f258c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:42.057390 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f574bd2b-9391-4a46-b85c-7557748f258c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:42.058484 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f574bd2b-9391-4a46-b85c-7557748f258c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:42.369942 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-f574bd2b-9391-4a46-b85c-7557748f258c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:42.369942 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-f574bd2b-9391-4a46-b85c-7557748f258c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1723 microversion: 2.1 time: 0.298687 Jun 24 10:03:42.369942 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 184/376] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:42 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1723 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:42.371358 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-b45ab2b7-e02b-4128-8c6a-3c7ba62a2180 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:42.371358 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-b45ab2b7-e02b-4128-8c6a-3c7ba62a2180 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1564 microversion: 2.1 time: 0.549429 Jun 24 10:03:42.371358 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 193/377] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:41 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1564 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:42.393434 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-14ac6c9d-15cc-45ad-a68f-1e4a027cd866 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:42.394084 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-14ac6c9d-15cc-45ad-a68f-1e4a027cd866 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:42.400428 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-14ac6c9d-15cc-45ad-a68f-1e4a027cd866 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:42.405803 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-14ac6c9d-15cc-45ad-a68f-1e4a027cd866 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:42.420920 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-14ac6c9d-15cc-45ad-a68f-1e4a027cd866 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:42.420920 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-14ac6c9d-15cc-45ad-a68f-1e4a027cd866 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:42.682726 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-14ac6c9d-15cc-45ad-a68f-1e4a027cd866 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.204170 Jun 24 10:03:42.682726 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 185/378] 10.222.0.26 () {58 vars in 1274 bytes} [Fri Jun 24 10:03:42 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716/os-interface => generated 284 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:03:42.964148 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-978d6dfa-f3e5-45fe-afd4-ea1bacc7aab5 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:42.964148 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-978d6dfa-f3e5-45fe-afd4-ea1bacc7aab5 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: b7951b2f-c465-46fa-9043-7d7e6f4b259a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:42.964148 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-978d6dfa-f3e5-45fe-afd4-ea1bacc7aab5 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:42.964148 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-978d6dfa-f3e5-45fe-afd4-ea1bacc7aab5 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:42.966612 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-978d6dfa-f3e5-45fe-afd4-ea1bacc7aab5 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:42.966612 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-978d6dfa-f3e5-45fe-afd4-ea1bacc7aab5 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:42.980971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-6382faf1-277e-497a-9d0d-1f766979a62f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:42.981844 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-6382faf1-277e-497a-9d0d-1f766979a62f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:42.993297 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6382faf1-277e-497a-9d0d-1f766979a62f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:42.996670 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6382faf1-277e-497a-9d0d-1f766979a62f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:42.997788 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6382faf1-277e-497a-9d0d-1f766979a62f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:42.998475 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6382faf1-277e-497a-9d0d-1f766979a62f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:43.213276 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-978d6dfa-f3e5-45fe-afd4-ea1bacc7aab5 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:43.223735 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-978d6dfa-f3e5-45fe-afd4-ea1bacc7aab5 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a" status: 200 len: 1312 microversion: 2.1 time: 0.435754 Jun 24 10:03:43.225553 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 194/379] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:42 2022] GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a => generated 1312 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:03:43.395976 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-1f6350bb-a2cf-49c0-b45b-a4223b723e23 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:43.400353 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-1f6350bb-a2cf-49c0-b45b-a4223b723e23 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:43.418912 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1f6350bb-a2cf-49c0-b45b-a4223b723e23 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:43.420105 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1f6350bb-a2cf-49c0-b45b-a4223b723e23 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:43.423564 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1f6350bb-a2cf-49c0-b45b-a4223b723e23 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:43.424955 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1f6350bb-a2cf-49c0-b45b-a4223b723e23 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:43.467070 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=100 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:03:43.723143 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-1f6350bb-a2cf-49c0-b45b-a4223b723e23 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:43.730178 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-1f6350bb-a2cf-49c0-b45b-a4223b723e23 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1723 microversion: 2.1 time: 0.346435 Jun 24 10:03:43.736205 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 195/380] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:43 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1723 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:44.068442 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-6382faf1-277e-497a-9d0d-1f766979a62f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:44.091109 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-6382faf1-277e-497a-9d0d-1f766979a62f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:44.092880 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-6382faf1-277e-497a-9d0d-1f766979a62f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:44.094065 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-6382faf1-277e-497a-9d0d-1f766979a62f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1737 microversion: 2.20 time: 1.117999 Jun 24 10:03:44.094620 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 186/381] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:42 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1737 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:03:44.209565 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-f2de4293-7e8b-4ab4-bdcb-9a3c084c759c req-5adf6c86-4957-4136-be5a-3013bb9c1bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7951b2f-c465-46fa-9043-7d7e6f4b259a", "name": "network-vif-plugged", "status": "completed", "tag": "7a2487cd-65e1-440a-993c-799a4156c918"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:03:44.234897 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-f2de4293-7e8b-4ab4-bdcb-9a3c084c759c req-5adf6c86-4957-4136-be5a-3013bb9c1bc0 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:44.234897 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-f2de4293-7e8b-4ab4-bdcb-9a3c084c759c req-5adf6c86-4957-4136-be5a-3013bb9c1bc0 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:44.242126 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-54cc6e3b-62b9-4311-8b30-d239852887a5 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:44.243287 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-54cc6e3b-62b9-4311-8b30-d239852887a5 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: b7951b2f-c465-46fa-9043-7d7e6f4b259a] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:44.260749 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-54cc6e3b-62b9-4311-8b30-d239852887a5 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:44.261464 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-54cc6e3b-62b9-4311-8b30-d239852887a5 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:44.262454 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-54cc6e3b-62b9-4311-8b30-d239852887a5 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:44.263966 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-f2de4293-7e8b-4ab4-bdcb-9a3c084c759c req-5adf6c86-4957-4136-be5a-3013bb9c1bc0 service nova] Creating event network-vif-plugged:7a2487cd-65e1-440a-993c-799a4156c918 for instance b7951b2f-c465-46fa-9043-7d7e6f4b259a on hv-cinder-84327 Jun 24 10:03:44.264631 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-54cc6e3b-62b9-4311-8b30-d239852887a5 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:44.274430 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-f2de4293-7e8b-4ab4-bdcb-9a3c084c759c req-5adf6c86-4957-4136-be5a-3013bb9c1bc0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068704 Jun 24 10:03:44.275544 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 196/382] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:03:44.745466 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-54cc6e3b-62b9-4311-8b30-d239852887a5 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:44.754617 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-8864246a-4987-45b8-a715-e58fa0affb97 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:44.755330 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-8864246a-4987-45b8-a715-e58fa0affb97 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:44.760490 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-54cc6e3b-62b9-4311-8b30-d239852887a5 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a" status: 200 len: 1312 microversion: 2.1 time: 0.522080 Jun 24 10:03:44.775501 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 187/383] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:44 2022] GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a => generated 1312 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:03:44.781164 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8864246a-4987-45b8-a715-e58fa0affb97 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:44.781625 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8864246a-4987-45b8-a715-e58fa0affb97 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:44.782426 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8864246a-4987-45b8-a715-e58fa0affb97 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:44.782867 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8864246a-4987-45b8-a715-e58fa0affb97 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:45.124234 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-53ae5e2a-285d-4c62-b1f4-40b98310e31a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:45.126297 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-53ae5e2a-285d-4c62-b1f4-40b98310e31a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:45.137637 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-53ae5e2a-285d-4c62-b1f4-40b98310e31a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:45.144501 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-53ae5e2a-285d-4c62-b1f4-40b98310e31a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:45.147269 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-53ae5e2a-285d-4c62-b1f4-40b98310e31a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:45.156851 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-53ae5e2a-285d-4c62-b1f4-40b98310e31a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:45.301963 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-8864246a-4987-45b8-a715-e58fa0affb97 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:45.314815 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-8864246a-4987-45b8-a715-e58fa0affb97 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1723 microversion: 2.1 time: 0.562980 Jun 24 10:03:45.315416 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 197/384] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:44 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1723 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:03:45.782334 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-53ae5e2a-285d-4c62-b1f4-40b98310e31a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:45.795121 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-53ae5e2a-285d-4c62-b1f4-40b98310e31a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:45.798776 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-1132562f-1d5a-47f0-9b7f-9a27edd3b313 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:45.798776 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-1132562f-1d5a-47f0-9b7f-9a27edd3b313 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: b7951b2f-c465-46fa-9043-7d7e6f4b259a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:45.798985 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-53ae5e2a-285d-4c62-b1f4-40b98310e31a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:45.800041 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-53ae5e2a-285d-4c62-b1f4-40b98310e31a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1737 microversion: 2.20 time: 0.689532 Jun 24 10:03:45.804457 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 188/385] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:45 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1737 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:03:45.834900 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1132562f-1d5a-47f0-9b7f-9a27edd3b313 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:45.834900 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1132562f-1d5a-47f0-9b7f-9a27edd3b313 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:45.835807 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1132562f-1d5a-47f0-9b7f-9a27edd3b313 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:45.836593 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1132562f-1d5a-47f0-9b7f-9a27edd3b313 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:46.177183 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-1132562f-1d5a-47f0-9b7f-9a27edd3b313 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:46.193655 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-1132562f-1d5a-47f0-9b7f-9a27edd3b313 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a" status: 200 len: 1312 microversion: 2.1 time: 0.404706 Jun 24 10:03:46.200025 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 198/386] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:45 2022] GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a => generated 1312 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:46.294313 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-1abae303-5577-4589-a2a9-2e8f60f44f71 req-b28fc60c-b417-460f-8315-0e2588582980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "904eb348-521e-499e-8127-cb3096230877", "name": "network-vif-plugged", "status": "completed", "tag": "bc68c0d7-3cc3-4add-8d35-8b1892ac129e"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:03:46.324886 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-1abae303-5577-4589-a2a9-2e8f60f44f71 req-b28fc60c-b417-460f-8315-0e2588582980 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:46.325361 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-1abae303-5577-4589-a2a9-2e8f60f44f71 req-b28fc60c-b417-460f-8315-0e2588582980 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:46.333185 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-85cda9c0-dcdc-4885-9cd5-c9339a4339bb tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:46.333793 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-85cda9c0-dcdc-4885-9cd5-c9339a4339bb tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:46.358426 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-85cda9c0-dcdc-4885-9cd5-c9339a4339bb tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:46.358990 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-85cda9c0-dcdc-4885-9cd5-c9339a4339bb tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:46.359820 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-85cda9c0-dcdc-4885-9cd5-c9339a4339bb tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:46.360292 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-85cda9c0-dcdc-4885-9cd5-c9339a4339bb tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:46.405758 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-1abae303-5577-4589-a2a9-2e8f60f44f71 req-b28fc60c-b417-460f-8315-0e2588582980 service nova] Creating event network-vif-plugged:bc68c0d7-3cc3-4add-8d35-8b1892ac129e for instance 904eb348-521e-499e-8127-cb3096230877 on hv-cinder-84327 Jun 24 10:03:46.411478 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-1abae303-5577-4589-a2a9-2e8f60f44f71 req-b28fc60c-b417-460f-8315-0e2588582980 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121835 Jun 24 10:03:46.415348 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 189/387] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:03:46.634936 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-85cda9c0-dcdc-4885-9cd5-c9339a4339bb tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:46.645203 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-85cda9c0-dcdc-4885-9cd5-c9339a4339bb tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1723 microversion: 2.1 time: 0.315763 Jun 24 10:03:46.646828 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 199/388] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:46 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1723 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:03:46.725501 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-e0bb446f-fb40-464d-830b-a974db08899d req-40e8b999-84bf-4285-8768-60a274a7712d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c170d532-d8da-4b26-879d-22c7dc180716", "tag": "62ac8ae2-de6d-4539-8e21-9a572eab33d9"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:03:46.749305 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-e0bb446f-fb40-464d-830b-a974db08899d req-40e8b999-84bf-4285-8768-60a274a7712d service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:46.751876 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-e0bb446f-fb40-464d-830b-a974db08899d req-40e8b999-84bf-4285-8768-60a274a7712d service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:46.786602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-e0bb446f-fb40-464d-830b-a974db08899d req-40e8b999-84bf-4285-8768-60a274a7712d service nova] Creating event network-changed:62ac8ae2-de6d-4539-8e21-9a572eab33d9 for instance c170d532-d8da-4b26-879d-22c7dc180716 on hv-cinder-84327 Jun 24 10:03:46.800933 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-e0bb446f-fb40-464d-830b-a974db08899d req-40e8b999-84bf-4285-8768-60a274a7712d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080412 Jun 24 10:03:46.803794 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 190/389] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:03:46.821663 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-12134e61-cdd1-4418-8fab-50336689a163 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:46.822359 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-12134e61-cdd1-4418-8fab-50336689a163 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:46.845058 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-12134e61-cdd1-4418-8fab-50336689a163 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:46.845509 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-12134e61-cdd1-4418-8fab-50336689a163 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:46.846298 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-12134e61-cdd1-4418-8fab-50336689a163 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:46.846737 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-12134e61-cdd1-4418-8fab-50336689a163 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:47.219884 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-12134e61-cdd1-4418-8fab-50336689a163 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:47.222423 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-0f193702-427d-4d07-a574-c3300d08ae45 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:47.223154 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-0f193702-427d-4d07-a574-c3300d08ae45 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: b7951b2f-c465-46fa-9043-7d7e6f4b259a] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:47.232978 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-12134e61-cdd1-4418-8fab-50336689a163 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:47.235754 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-12134e61-cdd1-4418-8fab-50336689a163 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:47.237562 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-12134e61-cdd1-4418-8fab-50336689a163 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1737 microversion: 2.20 time: 0.420412 Jun 24 10:03:47.250593 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 200/390] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:46 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1737 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:03:47.255142 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0f193702-427d-4d07-a574-c3300d08ae45 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:47.255603 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0f193702-427d-4d07-a574-c3300d08ae45 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:47.256418 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0f193702-427d-4d07-a574-c3300d08ae45 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:47.269965 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0f193702-427d-4d07-a574-c3300d08ae45 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:47.663480 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-2faabbc9-128b-4a90-ad65-2ba08555280c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:47.665411 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-2faabbc9-128b-4a90-ad65-2ba08555280c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:47.678922 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2faabbc9-128b-4a90-ad65-2ba08555280c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:47.682533 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2faabbc9-128b-4a90-ad65-2ba08555280c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:47.684923 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2faabbc9-128b-4a90-ad65-2ba08555280c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:47.688695 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2faabbc9-128b-4a90-ad65-2ba08555280c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:47.816611 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-0f193702-427d-4d07-a574-c3300d08ae45 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:47.828295 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-0f193702-427d-4d07-a574-c3300d08ae45 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a" status: 200 len: 1312 microversion: 2.1 time: 0.615710 Jun 24 10:03:47.850901 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 191/391] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:47 2022] GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a => generated 1312 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:48.175514 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-2faabbc9-128b-4a90-ad65-2ba08555280c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:48.190083 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-2faabbc9-128b-4a90-ad65-2ba08555280c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1723 microversion: 2.1 time: 0.530312 Jun 24 10:03:48.191112 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 201/392] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:47 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1723 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:48.259070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-534c5cab-d3d0-41f9-b06f-717a58adc41e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:48.259070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-534c5cab-d3d0-41f9-b06f-717a58adc41e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:48.266786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-534c5cab-d3d0-41f9-b06f-717a58adc41e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:48.267239 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-534c5cab-d3d0-41f9-b06f-717a58adc41e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:48.268017 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-534c5cab-d3d0-41f9-b06f-717a58adc41e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:48.283514 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-534c5cab-d3d0-41f9-b06f-717a58adc41e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:48.673311 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-534c5cab-d3d0-41f9-b06f-717a58adc41e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:48.689141 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-534c5cab-d3d0-41f9-b06f-717a58adc41e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:48.697599 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-534c5cab-d3d0-41f9-b06f-717a58adc41e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:48.699875 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-534c5cab-d3d0-41f9-b06f-717a58adc41e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1737 microversion: 2.20 time: 0.447051 Jun 24 10:03:48.716799 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 192/393] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:48 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1737 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:03:48.857612 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-7adbac21-fa47-48dc-b730-9f36518e211b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:48.857612 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-7adbac21-fa47-48dc-b730-9f36518e211b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: b7951b2f-c465-46fa-9043-7d7e6f4b259a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:48.871878 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7adbac21-fa47-48dc-b730-9f36518e211b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:48.874100 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7adbac21-fa47-48dc-b730-9f36518e211b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:48.875180 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7adbac21-fa47-48dc-b730-9f36518e211b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:48.880204 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7adbac21-fa47-48dc-b730-9f36518e211b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:49.198902 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-7adbac21-fa47-48dc-b730-9f36518e211b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:49.210642 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-7adbac21-fa47-48dc-b730-9f36518e211b tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a" status: 200 len: 1497 microversion: 2.1 time: 0.363550 Jun 24 10:03:49.227269 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 202/394] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:48 2022] GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a => generated 1497 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:49.241733 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-99430d8b-cba4-40db-a9a4-820ee93f2cc3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:49.245390 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-99430d8b-cba4-40db-a9a4-820ee93f2cc3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:49.314495 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-99430d8b-cba4-40db-a9a4-820ee93f2cc3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:49.314495 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-99430d8b-cba4-40db-a9a4-820ee93f2cc3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:49.331259 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-99430d8b-cba4-40db-a9a4-820ee93f2cc3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:49.342734 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-99430d8b-cba4-40db-a9a4-820ee93f2cc3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:49.725219 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-9fb9b4ef-6850-45ad-bc76-afcb1a62d9ed tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:49.726233 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-9fb9b4ef-6850-45ad-bc76-afcb1a62d9ed tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:49.734000 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9fb9b4ef-6850-45ad-bc76-afcb1a62d9ed tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:49.734677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9fb9b4ef-6850-45ad-bc76-afcb1a62d9ed tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:49.735810 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9fb9b4ef-6850-45ad-bc76-afcb1a62d9ed tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:49.736434 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9fb9b4ef-6850-45ad-bc76-afcb1a62d9ed tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:49.744425 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-99430d8b-cba4-40db-a9a4-820ee93f2cc3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:49.754864 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-99430d8b-cba4-40db-a9a4-820ee93f2cc3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1700 microversion: 2.1 time: 0.550684 Jun 24 10:03:49.764166 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 193/395] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:49 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1700 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:49.792506 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-9eba39d0-8486-461b-9fbd-ae289188e1ef tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:03:49.810206 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9eba39d0-8486-461b-9fbd-ae289188e1ef tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:49.819291 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9eba39d0-8486-461b-9fbd-ae289188e1ef tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:49.910348 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-9eba39d0-8486-461b-9fbd-ae289188e1ef tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Going to try to start instance {{(pid=124980) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 24 10:03:50.055457 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-9fb9b4ef-6850-45ad-bc76-afcb1a62d9ed tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:50.067969 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-9fb9b4ef-6850-45ad-bc76-afcb1a62d9ed tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:50.069993 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-9fb9b4ef-6850-45ad-bc76-afcb1a62d9ed tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:50.073838 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-9fb9b4ef-6850-45ad-bc76-afcb1a62d9ed tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1737 microversion: 2.20 time: 0.352311 Jun 24 10:03:50.089615 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:03:50.094135 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 203/396] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:49 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1737 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:03:50.187332 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-9eba39d0-8486-461b-9fbd-ae289188e1ef tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "POST /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e/action" status: 202 len: 0 microversion: 2.1 time: 0.414599 Jun 24 10:03:50.188600 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 194/397] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Jun 24 10:03:49 2022] POST /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e/action => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:03:50.208402 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-74c4d86d-ade9-4236-88f9-1472fe84cae5 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:50.208402 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-74c4d86d-ade9-4236-88f9-1472fe84cae5 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:50.246242 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-74c4d86d-ade9-4236-88f9-1472fe84cae5 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:50.247670 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-74c4d86d-ade9-4236-88f9-1472fe84cae5 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:50.250488 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-74c4d86d-ade9-4236-88f9-1472fe84cae5 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:50.254181 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-74c4d86d-ade9-4236-88f9-1472fe84cae5 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:50.795360 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-74c4d86d-ade9-4236-88f9-1472fe84cae5 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:50.813970 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-74c4d86d-ade9-4236-88f9-1472fe84cae5 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1709 microversion: 2.1 time: 0.617758 Jun 24 10:03:50.814580 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 204/398] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:50 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1709 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:50.872628 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-3bd36573-a605-45b6-9ece-9141cefb5d0c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:50.872628 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-3bd36573-a605-45b6-9ece-9141cefb5d0c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: b7951b2f-c465-46fa-9043-7d7e6f4b259a] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:50.892007 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3bd36573-a605-45b6-9ece-9141cefb5d0c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:50.892751 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3bd36573-a605-45b6-9ece-9141cefb5d0c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:50.898172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3bd36573-a605-45b6-9ece-9141cefb5d0c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:50.899400 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3bd36573-a605-45b6-9ece-9141cefb5d0c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:50.950819 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-3bd36573-a605-45b6-9ece-9141cefb5d0c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: b7951b2f-c465-46fa-9043-7d7e6f4b259a] Going to try to terminate instance {{(pid=124980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:03:51.091449 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-3ee4882e-f65f-4fe9-9b6b-b5e9a7f6768a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:51.092532 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-3ee4882e-f65f-4fe9-9b6b-b5e9a7f6768a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:51.106484 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3ee4882e-f65f-4fe9-9b6b-b5e9a7f6768a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:51.106948 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3ee4882e-f65f-4fe9-9b6b-b5e9a7f6768a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:51.109932 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3ee4882e-f65f-4fe9-9b6b-b5e9a7f6768a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:51.111468 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3ee4882e-f65f-4fe9-9b6b-b5e9a7f6768a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:51.544156 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-3bd36573-a605-45b6-9ece-9141cefb5d0c tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a" status: 204 len: 0 microversion: 2.1 time: 0.685298 Jun 24 10:03:51.545055 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 195/399] 10.222.0.26 () {58 vars in 1238 bytes} [Fri Jun 24 10:03:50 2022] DELETE /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a => generated 0 bytes in 689 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:03:51.566620 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-04450397-1673-40c0-9db9-80ec892c5077 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:51.566620 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-04450397-1673-40c0-9db9-80ec892c5077 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: b7951b2f-c465-46fa-9043-7d7e6f4b259a] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:51.572653 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-04450397-1673-40c0-9db9-80ec892c5077 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:51.573112 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-04450397-1673-40c0-9db9-80ec892c5077 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:51.573912 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-04450397-1673-40c0-9db9-80ec892c5077 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:51.574359 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-04450397-1673-40c0-9db9-80ec892c5077 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:51.601283 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-3ee4882e-f65f-4fe9-9b6b-b5e9a7f6768a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:51.610673 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-3ee4882e-f65f-4fe9-9b6b-b5e9a7f6768a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:51.616311 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-3ee4882e-f65f-4fe9-9b6b-b5e9a7f6768a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:51.620362 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-3ee4882e-f65f-4fe9-9b6b-b5e9a7f6768a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1737 microversion: 2.20 time: 0.534686 Jun 24 10:03:51.624500 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 205/400] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:51 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1737 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:03:51.848965 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-0d5b9841-eee1-44b0-a0d7-58fee90ab973 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:51.853353 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-0d5b9841-eee1-44b0-a0d7-58fee90ab973 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:51.886832 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0d5b9841-eee1-44b0-a0d7-58fee90ab973 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:51.887474 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0d5b9841-eee1-44b0-a0d7-58fee90ab973 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:51.888355 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0d5b9841-eee1-44b0-a0d7-58fee90ab973 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:51.899326 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0d5b9841-eee1-44b0-a0d7-58fee90ab973 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:51.927669 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-04450397-1673-40c0-9db9-80ec892c5077 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:51.941428 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-04450397-1673-40c0-9db9-80ec892c5077 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a" status: 200 len: 1503 microversion: 2.1 time: 0.390297 Jun 24 10:03:51.943291 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 196/401] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:51 2022] GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a => generated 1503 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:03:52.237398 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-0d5b9841-eee1-44b0-a0d7-58fee90ab973 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:52.247800 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-0d5b9841-eee1-44b0-a0d7-58fee90ab973 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1709 microversion: 2.1 time: 0.416713 Jun 24 10:03:52.251561 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 206/402] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:51 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1709 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:03:52.641287 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-f71f5170-ba89-4735-a1e0-8a45a9c11897 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:52.641973 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-f71f5170-ba89-4735-a1e0-8a45a9c11897 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:52.656067 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f71f5170-ba89-4735-a1e0-8a45a9c11897 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:52.661561 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f71f5170-ba89-4735-a1e0-8a45a9c11897 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:52.664757 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f71f5170-ba89-4735-a1e0-8a45a9c11897 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:52.665428 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f71f5170-ba89-4735-a1e0-8a45a9c11897 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:53.005854 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-ca5a1136-2c9d-4af9-8f01-99ff31338068 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:53.005854 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-ca5a1136-2c9d-4af9-8f01-99ff31338068 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: b7951b2f-c465-46fa-9043-7d7e6f4b259a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:53.005854 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ca5a1136-2c9d-4af9-8f01-99ff31338068 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:53.005854 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ca5a1136-2c9d-4af9-8f01-99ff31338068 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:53.006180 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ca5a1136-2c9d-4af9-8f01-99ff31338068 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:53.006180 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ca5a1136-2c9d-4af9-8f01-99ff31338068 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:53.223735 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-ca5a1136-2c9d-4af9-8f01-99ff31338068 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:53.232106 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-ca5a1136-2c9d-4af9-8f01-99ff31338068 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a" status: 200 len: 1503 microversion: 2.1 time: 0.276436 Jun 24 10:03:53.232716 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 207/403] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:52 2022] GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a => generated 1503 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:03:53.270488 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-4257b428-61dc-4f70-852f-88539b97eda8 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:53.274166 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-4257b428-61dc-4f70-852f-88539b97eda8 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:53.280501 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4257b428-61dc-4f70-852f-88539b97eda8 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:53.280937 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4257b428-61dc-4f70-852f-88539b97eda8 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:53.288052 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4257b428-61dc-4f70-852f-88539b97eda8 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:53.288536 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4257b428-61dc-4f70-852f-88539b97eda8 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:53.395130 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-f71f5170-ba89-4735-a1e0-8a45a9c11897 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:53.411318 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-f71f5170-ba89-4735-a1e0-8a45a9c11897 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:53.413260 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-f71f5170-ba89-4735-a1e0-8a45a9c11897 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:53.414707 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-f71f5170-ba89-4735-a1e0-8a45a9c11897 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1737 microversion: 2.20 time: 0.778471 Jun 24 10:03:53.415423 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 197/404] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:52 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1737 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:03:53.651093 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-4257b428-61dc-4f70-852f-88539b97eda8 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:53.676437 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-4257b428-61dc-4f70-852f-88539b97eda8 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1709 microversion: 2.1 time: 0.408601 Jun 24 10:03:53.682151 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 208/405] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:53 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1709 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:03:54.257043 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-c0dde4a7-f467-4bf4-a95e-4da641178ca4 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:54.257043 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-c0dde4a7-f467-4bf4-a95e-4da641178ca4 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: b7951b2f-c465-46fa-9043-7d7e6f4b259a] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:54.271892 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c0dde4a7-f467-4bf4-a95e-4da641178ca4 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:54.271892 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c0dde4a7-f467-4bf4-a95e-4da641178ca4 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:54.271892 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c0dde4a7-f467-4bf4-a95e-4da641178ca4 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:54.271892 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c0dde4a7-f467-4bf4-a95e-4da641178ca4 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:54.430791 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-c0dde4a7-f467-4bf4-a95e-4da641178ca4 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:54.438266 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-4d544f40-57f6-4872-b09d-ea57a9921b05 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:54.439738 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-4d544f40-57f6-4872-b09d-ea57a9921b05 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:54.452095 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4d544f40-57f6-4872-b09d-ea57a9921b05 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:54.456897 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4d544f40-57f6-4872-b09d-ea57a9921b05 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:54.457108 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-c0dde4a7-f467-4bf4-a95e-4da641178ca4 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a" status: 200 len: 1461 microversion: 2.1 time: 0.200361 Jun 24 10:03:54.467842 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4d544f40-57f6-4872-b09d-ea57a9921b05 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:54.468057 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 198/406] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:54 2022] GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a => generated 1461 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:54.473637 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4d544f40-57f6-4872-b09d-ea57a9921b05 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:54.505814 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-33f7a304-382f-4791-b06c-3e884312c09e req-63c67016-e5b9-4664-8d41-98f3eb8579ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7951b2f-c465-46fa-9043-7d7e6f4b259a", "name": "network-vif-deleted", "tag": "7a2487cd-65e1-440a-993c-799a4156c918"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:03:54.522147 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-33f7a304-382f-4791-b06c-3e884312c09e req-63c67016-e5b9-4664-8d41-98f3eb8579ea service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:54.524356 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-33f7a304-382f-4791-b06c-3e884312c09e req-63c67016-e5b9-4664-8d41-98f3eb8579ea service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:54.554525 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-33f7a304-382f-4791-b06c-3e884312c09e req-63c67016-e5b9-4664-8d41-98f3eb8579ea service nova] Creating event network-vif-deleted:7a2487cd-65e1-440a-993c-799a4156c918 for instance b7951b2f-c465-46fa-9043-7d7e6f4b259a on hv-cinder-84327 Jun 24 10:03:54.563671 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-33f7a304-382f-4791-b06c-3e884312c09e req-63c67016-e5b9-4664-8d41-98f3eb8579ea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062078 Jun 24 10:03:54.567148 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 199/407] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:03:54.708175 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-e6afbed0-2438-4a73-9fcd-9259a50e56b3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:54.709421 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-e6afbed0-2438-4a73-9fcd-9259a50e56b3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:54.728958 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e6afbed0-2438-4a73-9fcd-9259a50e56b3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:54.734009 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e6afbed0-2438-4a73-9fcd-9259a50e56b3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:54.737481 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e6afbed0-2438-4a73-9fcd-9259a50e56b3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:54.738506 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e6afbed0-2438-4a73-9fcd-9259a50e56b3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:54.851782 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-4d544f40-57f6-4872-b09d-ea57a9921b05 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:54.860916 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-4d544f40-57f6-4872-b09d-ea57a9921b05 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:54.862408 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-4d544f40-57f6-4872-b09d-ea57a9921b05 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:54.863575 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-4d544f40-57f6-4872-b09d-ea57a9921b05 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1737 microversion: 2.20 time: 0.431472 Jun 24 10:03:54.864114 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 209/408] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:54 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1737 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:03:54.973908 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-e6afbed0-2438-4a73-9fcd-9259a50e56b3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:54.983502 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-e6afbed0-2438-4a73-9fcd-9259a50e56b3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1713 microversion: 2.1 time: 0.286346 Jun 24 10:03:54.993599 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 200/409] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:54 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1713 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:55.480045 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-15aff5af-c5cd-49dd-82a9-ee82b99c9be8 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:55.480716 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-15aff5af-c5cd-49dd-82a9-ee82b99c9be8 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: b7951b2f-c465-46fa-9043-7d7e6f4b259a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:55.496360 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-15aff5af-c5cd-49dd-82a9-ee82b99c9be8 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:55.496808 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-15aff5af-c5cd-49dd-82a9-ee82b99c9be8 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:55.498092 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-15aff5af-c5cd-49dd-82a9-ee82b99c9be8 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:55.498526 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-15aff5af-c5cd-49dd-82a9-ee82b99c9be8 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:55.635180 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-15aff5af-c5cd-49dd-82a9-ee82b99c9be8 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:55.640429 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-15aff5af-c5cd-49dd-82a9-ee82b99c9be8 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:55.641412 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.objects.instance [None req-15aff5af-c5cd-49dd-82a9-ee82b99c9be8 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lazy-loading 'fault' on Instance uuid b7951b2f-c465-46fa-9043-7d7e6f4b259a {{(pid=124979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:03:55.779394 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-15aff5af-c5cd-49dd-82a9-ee82b99c9be8 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff0cf4a0b4e04ce79340bac70992bf32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f896de1750fe4c7d9eef897027efb42f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:55.793770 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-15aff5af-c5cd-49dd-82a9-ee82b99c9be8 tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a" status: 200 len: 1302 microversion: 2.1 time: 0.317347 Jun 24 10:03:55.795729 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 210/410] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:55 2022] GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a => generated 1302 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:03:55.882268 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-0872b626-a36c-460d-b164-c25d29174410 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:55.882811 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-0872b626-a36c-460d-b164-c25d29174410 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:55.892402 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0872b626-a36c-460d-b164-c25d29174410 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:55.893107 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0872b626-a36c-460d-b164-c25d29174410 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:55.894040 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0872b626-a36c-460d-b164-c25d29174410 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:55.894657 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0872b626-a36c-460d-b164-c25d29174410 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:56.186447 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-0872b626-a36c-460d-b164-c25d29174410 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:56.200278 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-0872b626-a36c-460d-b164-c25d29174410 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:56.200278 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-0872b626-a36c-460d-b164-c25d29174410 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:56.201914 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-0872b626-a36c-460d-b164-c25d29174410 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1737 microversion: 2.20 time: 0.323591 Jun 24 10:03:56.218270 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 201/411] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:55 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1737 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:03:56.817295 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-23606010-196f-4481-a70e-15e17834ca7f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:56.818582 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-23606010-196f-4481-a70e-15e17834ca7f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] [instance: b7951b2f-c465-46fa-9043-7d7e6f4b259a] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:56.826822 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-23606010-196f-4481-a70e-15e17834ca7f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:56.827622 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-23606010-196f-4481-a70e-15e17834ca7f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:56.828669 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-23606010-196f-4481-a70e-15e17834ca7f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:56.829886 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-23606010-196f-4481-a70e-15e17834ca7f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:56.847990 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-23606010-196f-4481-a70e-15e17834ca7f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] HTTP exception thrown: Instance b7951b2f-c465-46fa-9043-7d7e6f4b259a could not be found. Jun 24 10:03:56.861427 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-23606010-196f-4481-a70e-15e17834ca7f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Request method failure captured: Jun 24 10:03:56.861427 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a HTTP/1.1 Jun 24 10:03:56.861427 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:03:56.861427 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:03:56.861427 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:03:56.861427 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 0 Jun 24 10:03:56.861427 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:03:56.861427 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:03:56.861427 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:03:56.861427 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:03:56.861427 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitYu7D_GarVoOmf-ivaKDHwIsvjqspiTOWplbHrY2ukG0Qpb3IIDDcAso5o5JNTVcUJHeHwcp5toIbG_A9wranxfOTiw7Gdjvz03wFx8LxTb6VGlNGqLp3lurr8s8lB9qvtbKXQSFgR-nHagrNdKDd9tdxN26Wo6Zj0ec3P9dFY4QCEA Jun 24 10:03:56.861427 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:03:56.861427 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:03:56.861427 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:03:56.861427 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:03:56.861427 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:03:56.861427 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:03:56.861427 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: f896de1750fe4c7d9eef897027efb42f Jun 24 10:03:56.861427 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-VolumesActionsTest-198756669 Jun 24 10:03:56.861427 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:03:56.861427 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:03:56.862677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f896de1750fe4c7d9eef897027efb42f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f896de1750fe4c7d9eef897027efb42f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f896de1750fe4c7d9eef897027efb42f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f896de1750fe4c7d9eef897027efb42f"}]}] Jun 24 10:03:56.862677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-VolumesActionsTest-198756669 Jun 24 10:03:56.862677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: f896de1750fe4c7d9eef897027efb42f Jun 24 10:03:56.862677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-VolumesActionsTest-198756669 Jun 24 10:03:56.862677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-VolumesActionsTest-198756669-project Jun 24 10:03:56.862677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:03:56.862677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:03:56.862677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: ff0cf4a0b4e04ce79340bac70992bf32 Jun 24 10:03:56.862677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-VolumesActionsTest-198756669-project Jun 24 10:03:56.862677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: > Jun 24 10:03:56.862677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Instance b7951b2f-c465-46fa-9043-7d7e6f4b259a could not be found. Jun 24 10:03:56.862677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'id': 'b7951b2f-c465-46fa-9043-7d7e6f4b259a'} Jun 24 10:03:56.863394 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:03:56.863394 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:03:56.863394 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:03:56.863394 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:03:56.863394 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:03:56.863394 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:03:56.863394 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:03:56.863394 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:03:56.863394 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:03:56.863394 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:03:56.863394 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7951b2f-c465-46fa-9043-7d7e6f4b259a could not be found. Jun 24 10:03:56.863394 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:03:56.863394 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:03:56.863394 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:03:56.863394 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:03:56.863394 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:03:56.863394 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:03:56.863394 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:03:56.863394 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:03:56.863394 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:03:56.864694 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:03:56.864694 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:03:56.864694 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:03:56.864694 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:03:56.864694 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:03:56.864694 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:03:56.864694 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:03:56.864694 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7951b2f-c465-46fa-9043-7d7e6f4b259a could not be found. Jun 24 10:03:56.864694 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:03:56.864694 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:03:56.864694 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:03:56.864694 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:03:56.864694 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:03:56.864694 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:03:56.864694 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:03:56.864694 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:03:56.864694 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7951b2f-c465-46fa-9043-7d7e6f4b259a could not be found. Jun 24 10:03:56.864694 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:03:56.865753 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-23606010-196f-4481-a70e-15e17834ca7f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] Returning 404 to user: Instance b7951b2f-c465-46fa-9043-7d7e6f4b259a could not be found. {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:03:56.865753 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-23606010-196f-4481-a70e-15e17834ca7f tempest-VolumesActionsTest-198756669 tempest-VolumesActionsTest-198756669-project] 10.222.0.26 "GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a" status: 404 len: 111 microversion: 2.1 time: 0.044783 Jun 24 10:03:56.865753 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 211/412] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:03:56 2022] GET /compute/v2.1/servers/b7951b2f-c465-46fa-9043-7d7e6f4b259a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:03:57.223872 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-1c60a104-74d4-434e-ac27-8a590c69cec0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:57.228596 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-1c60a104-74d4-434e-ac27-8a590c69cec0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:57.237279 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1c60a104-74d4-434e-ac27-8a590c69cec0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:57.237735 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1c60a104-74d4-434e-ac27-8a590c69cec0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:57.238518 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1c60a104-74d4-434e-ac27-8a590c69cec0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:57.238954 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1c60a104-74d4-434e-ac27-8a590c69cec0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:57.564975 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-1c60a104-74d4-434e-ac27-8a590c69cec0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:57.576765 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-1c60a104-74d4-434e-ac27-8a590c69cec0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:57.592922 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-1c60a104-74d4-434e-ac27-8a590c69cec0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:57.601031 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-1c60a104-74d4-434e-ac27-8a590c69cec0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1737 microversion: 2.20 time: 0.377488 Jun 24 10:03:57.612278 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 202/413] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:57 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1737 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:03:58.631575 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-1c2df659-5626-4b06-8423-1509a38cd07c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:03:58.632739 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-1c2df659-5626-4b06-8423-1509a38cd07c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:03:58.659932 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1c2df659-5626-4b06-8423-1509a38cd07c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:58.663805 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1c2df659-5626-4b06-8423-1509a38cd07c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:58.664854 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1c2df659-5626-4b06-8423-1509a38cd07c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:03:58.665512 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1c2df659-5626-4b06-8423-1509a38cd07c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:03:59.002462 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-1c2df659-5626-4b06-8423-1509a38cd07c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:59.006547 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=100 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:03:59.018734 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-1c2df659-5626-4b06-8423-1509a38cd07c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:59.020575 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-1c2df659-5626-4b06-8423-1509a38cd07c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:03:59.023058 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-1c2df659-5626-4b06-8423-1509a38cd07c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1737 microversion: 2.20 time: 0.406628 Jun 24 10:03:59.028584 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 212/414] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:03:58 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1737 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:00.046786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-115b8cb1-954c-46c8-8142-9f0a69931ba4 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:00.048770 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-115b8cb1-954c-46c8-8142-9f0a69931ba4 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:00.056765 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-115b8cb1-954c-46c8-8142-9f0a69931ba4 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:00.058726 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-115b8cb1-954c-46c8-8142-9f0a69931ba4 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:00.059703 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-115b8cb1-954c-46c8-8142-9f0a69931ba4 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:00.060578 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-115b8cb1-954c-46c8-8142-9f0a69931ba4 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:00.412307 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-115b8cb1-954c-46c8-8142-9f0a69931ba4 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:00.417288 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-115b8cb1-954c-46c8-8142-9f0a69931ba4 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:00.419357 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-115b8cb1-954c-46c8-8142-9f0a69931ba4 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:00.421171 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-115b8cb1-954c-46c8-8142-9f0a69931ba4 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1737 microversion: 2.20 time: 0.379083 Jun 24 10:04:00.421977 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 203/415] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:00 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1737 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:04:01.442459 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-f4e3184b-9e91-49f3-a89a-397b8cd37340 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:01.443185 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-f4e3184b-9e91-49f3-a89a-397b8cd37340 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:01.451273 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f4e3184b-9e91-49f3-a89a-397b8cd37340 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:01.452013 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f4e3184b-9e91-49f3-a89a-397b8cd37340 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:01.453071 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f4e3184b-9e91-49f3-a89a-397b8cd37340 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:01.453756 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f4e3184b-9e91-49f3-a89a-397b8cd37340 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:01.616230 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-f4e3184b-9e91-49f3-a89a-397b8cd37340 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:01.633280 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-f4e3184b-9e91-49f3-a89a-397b8cd37340 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:01.640214 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-f4e3184b-9e91-49f3-a89a-397b8cd37340 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:01.645063 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-f4e3184b-9e91-49f3-a89a-397b8cd37340 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1737 microversion: 2.20 time: 0.207556 Jun 24 10:04:01.662035 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 213/416] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:01 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1737 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:02.672551 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-e1a8332b-c72d-4a4a-ae6f-0204242c2778 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:02.672551 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-e1a8332b-c72d-4a4a-ae6f-0204242c2778 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:02.684940 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e1a8332b-c72d-4a4a-ae6f-0204242c2778 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:02.685559 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e1a8332b-c72d-4a4a-ae6f-0204242c2778 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:02.687834 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e1a8332b-c72d-4a4a-ae6f-0204242c2778 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:02.688317 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e1a8332b-c72d-4a4a-ae6f-0204242c2778 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:02.871426 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-e1a8332b-c72d-4a4a-ae6f-0204242c2778 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:02.882293 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-e1a8332b-c72d-4a4a-ae6f-0204242c2778 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:02.884308 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-e1a8332b-c72d-4a4a-ae6f-0204242c2778 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:02.885873 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-e1a8332b-c72d-4a4a-ae6f-0204242c2778 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1737 microversion: 2.20 time: 0.224211 Jun 24 10:04:02.897256 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 204/417] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:02 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1737 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:03.662842 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-3012f065-d50e-4bc3-a34e-84cc244c08ce tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Action: 'create', calling method: .version_select at 0x7f0309cf2550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-718733007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSxWwQHH3Vw7Q40ZzDk46D4dIs06jKENzyqkzuKvIrto08jggodHb4ePT9MGNLSr08AQVWU/tL8YcnXnzSufWh9rXnF59v75mCL9xfQ1tS+p1jySLJ01zTFbvMSkUHEtw=="}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:04:03.679057 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-3012f065-d50e-4bc3-a34e-84cc244c08ce tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Getting quotas for project a8f15fa49a284e409bdcabcca90ece04. Resources: {'key_pairs'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:04:03.687372 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-3012f065-d50e-4bc3-a34e-84cc244c08ce tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Getting quotas for user 9832856bd6e348508d5e0c2f5c7f234e and project a8f15fa49a284e409bdcabcca90ece04. Resources: {'key_pairs'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:04:03.842412 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-3012f065-d50e-4bc3-a34e-84cc244c08ce tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.183821 Jun 24 10:04:03.843337 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 214/418] 10.222.0.26 () {60 vars in 1158 bytes} [Fri Jun 24 10:04:03 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:04:03.904455 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-bee7aa4d-728e-4eab-86b7-b250021392d9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:03.905141 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-bee7aa4d-728e-4eab-86b7-b250021392d9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:03.913618 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-bee7aa4d-728e-4eab-86b7-b250021392d9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:03.913618 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-bee7aa4d-728e-4eab-86b7-b250021392d9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:03.913618 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-bee7aa4d-728e-4eab-86b7-b250021392d9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:03.913618 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-bee7aa4d-728e-4eab-86b7-b250021392d9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:03.961715 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-08736b14-689a-4909-b8c0-34907dbb20cd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1268926678", "imageRef": "e6e69db2-fc27-45b9-9fc1-56b23f4933f9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-718733007", "networks": [{"uuid": "b62e03e6-e652-4ef9-a19f-cc1036cc714a"}]}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:04:04.012583 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.network.neutron [None req-08736b14-689a-4909-b8c0-34907dbb20cd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] validate_networks() for [('b62e03e6-e652-4ef9-a19f-cc1036cc714a', None, None, None, None, None)] {{(pid=124979) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:04:04.116303 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-bee7aa4d-728e-4eab-86b7-b250021392d9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:04.128895 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-bee7aa4d-728e-4eab-86b7-b250021392d9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:04.130409 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-bee7aa4d-728e-4eab-86b7-b250021392d9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:04.131569 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-bee7aa4d-728e-4eab-86b7-b250021392d9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1737 microversion: 2.20 time: 0.231054 Jun 24 10:04:04.132162 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 205/419] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:03 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1737 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:04.425804 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-08736b14-689a-4909-b8c0-34907dbb20cd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Flavor limits 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:04:04.426227 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-08736b14-689a-4909-b8c0-34907dbb20cd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Image limits 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:04:04.426879 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-08736b14-689a-4909-b8c0-34907dbb20cd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Flavor pref 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:04:04.427290 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-08736b14-689a-4909-b8c0-34907dbb20cd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Image pref 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:04:04.427756 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-08736b14-689a-4909-b8c0-34907dbb20cd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:04:04.439078 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-08736b14-689a-4909-b8c0-34907dbb20cd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:04.439078 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-08736b14-689a-4909-b8c0-34907dbb20cd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:04.439078 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-08736b14-689a-4909-b8c0-34907dbb20cd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:04.439078 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-08736b14-689a-4909-b8c0-34907dbb20cd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:04.455835 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-08736b14-689a-4909-b8c0-34907dbb20cd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Getting quotas for project a8f15fa49a284e409bdcabcca90ece04. Resources: {'instances', 'cores', 'ram'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:04:04.459864 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-08736b14-689a-4909-b8c0-34907dbb20cd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Getting quotas for user 9832856bd6e348508d5e0c2f5c7f234e and project a8f15fa49a284e409bdcabcca90ece04. Resources: {'instances', 'cores', 'ram'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:04:04.473031 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-08736b14-689a-4909-b8c0-34907dbb20cd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Going to run 1 instances... {{(pid=124979) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:04:04.475252 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-08736b14-689a-4909-b8c0-34907dbb20cd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6e69db2-fc27-45b9-9fc1-56b23f4933f9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124979) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:04:04.601573 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-08736b14-689a-4909-b8c0-34907dbb20cd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643647 Jun 24 10:04:04.603197 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 215/420] 10.222.0.26 () {60 vars in 1146 bytes} [Fri Jun 24 10:04:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 10:04:04.619378 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-bdb6cfa5-f43a-4747-8013-d249717d5912 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:04.620002 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-bdb6cfa5-f43a-4747-8013-d249717d5912 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:04.682013 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-bdb6cfa5-f43a-4747-8013-d249717d5912 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:04.689846 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-bdb6cfa5-f43a-4747-8013-d249717d5912 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1258 microversion: 2.1 time: 0.080621 Jun 24 10:04:04.690557 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 206/421] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:04 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1258 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:05.150636 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-c16c3963-ed57-47ad-af4d-479adbe64049 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:05.151331 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-c16c3963-ed57-47ad-af4d-479adbe64049 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:05.159300 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c16c3963-ed57-47ad-af4d-479adbe64049 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:05.159822 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c16c3963-ed57-47ad-af4d-479adbe64049 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:05.160700 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c16c3963-ed57-47ad-af4d-479adbe64049 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:05.161223 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c16c3963-ed57-47ad-af4d-479adbe64049 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:05.403101 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-c16c3963-ed57-47ad-af4d-479adbe64049 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:05.415452 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-c16c3963-ed57-47ad-af4d-479adbe64049 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:05.417928 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-c16c3963-ed57-47ad-af4d-479adbe64049 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:05.420242 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-c16c3963-ed57-47ad-af4d-479adbe64049 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1737 microversion: 2.20 time: 0.272909 Jun 24 10:04:05.421729 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 216/422] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:05 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1737 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:05.706954 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-5bb69b99-fe19-488d-ae79-85e41a5d66b0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:05.707475 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-5bb69b99-fe19-488d-ae79-85e41a5d66b0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:05.779399 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-5bb69b99-fe19-488d-ae79-85e41a5d66b0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:05.787631 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-5bb69b99-fe19-488d-ae79-85e41a5d66b0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1258 microversion: 2.1 time: 0.084663 Jun 24 10:04:05.788867 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 207/423] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:05 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1258 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:06.439040 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-9675dfbc-1b9e-45fe-9892-b64bc148cde7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:06.439644 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-9675dfbc-1b9e-45fe-9892-b64bc148cde7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:06.447149 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9675dfbc-1b9e-45fe-9892-b64bc148cde7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:06.447607 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9675dfbc-1b9e-45fe-9892-b64bc148cde7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:06.448418 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9675dfbc-1b9e-45fe-9892-b64bc148cde7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:06.448861 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9675dfbc-1b9e-45fe-9892-b64bc148cde7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:06.656353 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-9675dfbc-1b9e-45fe-9892-b64bc148cde7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:06.667651 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-9675dfbc-1b9e-45fe-9892-b64bc148cde7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:06.671053 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-9675dfbc-1b9e-45fe-9892-b64bc148cde7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:06.672523 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-9675dfbc-1b9e-45fe-9892-b64bc148cde7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1719 microversion: 2.20 time: 0.237582 Jun 24 10:04:06.685780 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 217/424] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:06 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1719 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:06.807230 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-2d71f308-de8c-4507-92c8-00059309e6fe tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:06.808559 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-2d71f308-de8c-4507-92c8-00059309e6fe tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:06.828775 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2d71f308-de8c-4507-92c8-00059309e6fe tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:06.829233 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2d71f308-de8c-4507-92c8-00059309e6fe tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:06.830023 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2d71f308-de8c-4507-92c8-00059309e6fe tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:06.831457 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2d71f308-de8c-4507-92c8-00059309e6fe tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:06.902697 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2d71f308-de8c-4507-92c8-00059309e6fe tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:06.910452 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-2d71f308-de8c-4507-92c8-00059309e6fe tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1254 microversion: 2.1 time: 0.108201 Jun 24 10:04:06.912056 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 208/425] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:06 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1254 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:07.692494 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-62cc62f1-3ad7-42b9-ab2b-c03451de9205 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:07.693694 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-62cc62f1-3ad7-42b9-ab2b-c03451de9205 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:07.705111 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-62cc62f1-3ad7-42b9-ab2b-c03451de9205 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:07.706028 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-62cc62f1-3ad7-42b9-ab2b-c03451de9205 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:07.706984 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-62cc62f1-3ad7-42b9-ab2b-c03451de9205 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:07.707425 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-62cc62f1-3ad7-42b9-ab2b-c03451de9205 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:07.924097 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-62cc62f1-3ad7-42b9-ab2b-c03451de9205 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:07.929532 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-efc9091c-fdcc-46e5-96bc-c250f0548168 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:07.930297 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-efc9091c-fdcc-46e5-96bc-c250f0548168 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:07.934594 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-62cc62f1-3ad7-42b9-ab2b-c03451de9205 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:07.937497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-62cc62f1-3ad7-42b9-ab2b-c03451de9205 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:07.939831 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-62cc62f1-3ad7-42b9-ab2b-c03451de9205 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1719 microversion: 2.20 time: 0.251562 Jun 24 10:04:07.944730 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 218/426] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:07 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1719 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:07.954059 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-efc9091c-fdcc-46e5-96bc-c250f0548168 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:07.956704 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-efc9091c-fdcc-46e5-96bc-c250f0548168 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:07.959502 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-efc9091c-fdcc-46e5-96bc-c250f0548168 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:07.962981 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-efc9091c-fdcc-46e5-96bc-c250f0548168 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:08.022600 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-2afc9d54-fb74-44f7-931e-2c25bfe58f8c req-55d9fb66-70ba-420b-ac01-f237a21de2fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "904eb348-521e-499e-8127-cb3096230877", "name": "network-vif-unplugged", "status": "completed", "tag": "bc68c0d7-3cc3-4add-8d35-8b1892ac129e"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:04:08.034195 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-2afc9d54-fb74-44f7-931e-2c25bfe58f8c req-55d9fb66-70ba-420b-ac01-f237a21de2fb service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:08.034735 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-2afc9d54-fb74-44f7-931e-2c25bfe58f8c req-55d9fb66-70ba-420b-ac01-f237a21de2fb service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:08.046852 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-2afc9d54-fb74-44f7-931e-2c25bfe58f8c req-55d9fb66-70ba-420b-ac01-f237a21de2fb service nova] Creating event network-vif-unplugged:bc68c0d7-3cc3-4add-8d35-8b1892ac129e for instance 904eb348-521e-499e-8127-cb3096230877 on hv-cinder-84327 Jun 24 10:04:08.052280 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-2afc9d54-fb74-44f7-931e-2c25bfe58f8c req-55d9fb66-70ba-420b-ac01-f237a21de2fb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035710 Jun 24 10:04:08.053403 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 219/427] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:04:08.078990 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-efc9091c-fdcc-46e5-96bc-c250f0548168 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:08.083438 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-efc9091c-fdcc-46e5-96bc-c250f0548168 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1254 microversion: 2.1 time: 0.157974 Jun 24 10:04:08.084252 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 209/428] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:07 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1254 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:08.963574 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-f813b02f-dfd2-4492-9b90-950188e46ad2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:08.964853 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-f813b02f-dfd2-4492-9b90-950188e46ad2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:08.968304 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:04:08.980784 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f813b02f-dfd2-4492-9b90-950188e46ad2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:08.981945 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f813b02f-dfd2-4492-9b90-950188e46ad2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:08.982779 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f813b02f-dfd2-4492-9b90-950188e46ad2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:08.984337 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f813b02f-dfd2-4492-9b90-950188e46ad2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:09.106657 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-e629120e-3bbd-4126-8fc4-614ae038b690 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:09.108799 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-e629120e-3bbd-4126-8fc4-614ae038b690 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:09.120008 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e629120e-3bbd-4126-8fc4-614ae038b690 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:09.121125 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e629120e-3bbd-4126-8fc4-614ae038b690 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:09.122335 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e629120e-3bbd-4126-8fc4-614ae038b690 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:09.123102 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e629120e-3bbd-4126-8fc4-614ae038b690 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:09.272981 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-e629120e-3bbd-4126-8fc4-614ae038b690 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:09.286779 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-e629120e-3bbd-4126-8fc4-614ae038b690 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1318 microversion: 2.1 time: 0.189104 Jun 24 10:04:09.289590 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 210/429] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:09 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:04:09.487837 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-f813b02f-dfd2-4492-9b90-950188e46ad2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:09.499106 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-f813b02f-dfd2-4492-9b90-950188e46ad2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:09.500865 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-f813b02f-dfd2-4492-9b90-950188e46ad2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:09.502114 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-f813b02f-dfd2-4492-9b90-950188e46ad2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1722 microversion: 2.20 time: 0.542837 Jun 24 10:04:09.502659 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 220/430] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:08 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1722 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:04:09.521181 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-cb81d754-25ed-44e0-89a1-249cd4dfc2b6 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bef9b8ae-2c87-442c-b57f-6fc580beaab8"}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:04:09.522329 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-cb81d754-25ed-44e0-89a1-249cd4dfc2b6 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:09.532236 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-cb81d754-25ed-44e0-89a1-249cd4dfc2b6 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:09.532694 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-cb81d754-25ed-44e0-89a1-249cd4dfc2b6 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:09.533469 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-cb81d754-25ed-44e0-89a1-249cd4dfc2b6 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:09.533913 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-cb81d754-25ed-44e0-89a1-249cd4dfc2b6 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:10.308533 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-1197c2dd-0c92-4b39-8f3b-9366b5a1e318 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:10.318337 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-1197c2dd-0c92-4b39-8f3b-9366b5a1e318 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:10.318337 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1197c2dd-0c92-4b39-8f3b-9366b5a1e318 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:10.318337 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1197c2dd-0c92-4b39-8f3b-9366b5a1e318 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:10.318337 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1197c2dd-0c92-4b39-8f3b-9366b5a1e318 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:10.318832 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1197c2dd-0c92-4b39-8f3b-9366b5a1e318 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:10.435167 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:04:10.679514 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-1197c2dd-0c92-4b39-8f3b-9366b5a1e318 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:10.690319 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-1197c2dd-0c92-4b39-8f3b-9366b5a1e318 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1358 microversion: 2.1 time: 0.387472 Jun 24 10:04:10.690909 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 221/431] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:10 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1358 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:04:11.254651 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-cb81d754-25ed-44e0-89a1-249cd4dfc2b6 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "POST /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.736865 Jun 24 10:04:11.256211 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 211/432] 10.222.0.26 () {62 vars in 1363 bytes} [Fri Jun 24 10:04:09 2022] POST /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877/os-volume_attachments => generated 188 bytes in 1740 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:04:11.467299 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-44941669-08e1-4a6a-8166-fb7124e4b8e8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:04:11.468104 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-44941669-08e1-4a6a-8166-fb7124e4b8e8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:11.482497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-44941669-08e1-4a6a-8166-fb7124e4b8e8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:11.483233 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-44941669-08e1-4a6a-8166-fb7124e4b8e8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:11.484661 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-44941669-08e1-4a6a-8166-fb7124e4b8e8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:11.485175 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-44941669-08e1-4a6a-8166-fb7124e4b8e8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:11.711268 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-7bf433a0-fdb7-4d1f-a002-8eac3e12ba17 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:11.713131 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-7bf433a0-fdb7-4d1f-a002-8eac3e12ba17 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:11.723281 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:04:11.744355 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7bf433a0-fdb7-4d1f-a002-8eac3e12ba17 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:11.745479 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7bf433a0-fdb7-4d1f-a002-8eac3e12ba17 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:11.750263 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7bf433a0-fdb7-4d1f-a002-8eac3e12ba17 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:11.767021 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7bf433a0-fdb7-4d1f-a002-8eac3e12ba17 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:11.930717 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-44941669-08e1-4a6a-8166-fb7124e4b8e8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "POST /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877/action" status: 202 len: 0 microversion: 2.20 time: 0.462393 Jun 24 10:04:11.932279 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 222/433] 10.222.0.26 () {62 vars in 1318 bytes} [Fri Jun 24 10:04:11 2022] POST /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:04:11.944436 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-f2a6ebfc-5380-483d-a070-100766dcf675 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:11.945123 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-f2a6ebfc-5380-483d-a070-100766dcf675 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:11.962637 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f2a6ebfc-5380-483d-a070-100766dcf675 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:11.964888 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f2a6ebfc-5380-483d-a070-100766dcf675 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:11.968019 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f2a6ebfc-5380-483d-a070-100766dcf675 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:11.969518 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f2a6ebfc-5380-483d-a070-100766dcf675 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:12.299052 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-7bf433a0-fdb7-4d1f-a002-8eac3e12ba17 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:12.308722 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-7bf433a0-fdb7-4d1f-a002-8eac3e12ba17 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1358 microversion: 2.1 time: 0.605454 Jun 24 10:04:12.309806 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 212/434] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:11 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1358 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:04:12.516917 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-f2a6ebfc-5380-483d-a070-100766dcf675 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:12.527305 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-f2a6ebfc-5380-483d-a070-100766dcf675 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:12.529166 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-f2a6ebfc-5380-483d-a070-100766dcf675 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:12.530597 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-f2a6ebfc-5380-483d-a070-100766dcf675 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1748 microversion: 2.20 time: 0.594950 Jun 24 10:04:12.531751 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 223/435] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:11 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1748 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:12.742472 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-316ae2e0-0d39-4e58-8dab-dda9ea325411 req-97b3bcec-dacf-4d0e-b66e-f9061a09414f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af9804ec-09cf-4bd7-bf69-83dc28a5d1d5", "tag": "9232a5f7-d95a-44a5-b49d-7664a4d75f80"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:04:12.760529 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-316ae2e0-0d39-4e58-8dab-dda9ea325411 req-97b3bcec-dacf-4d0e-b66e-f9061a09414f service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:12.761309 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-316ae2e0-0d39-4e58-8dab-dda9ea325411 req-97b3bcec-dacf-4d0e-b66e-f9061a09414f service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:12.782268 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-316ae2e0-0d39-4e58-8dab-dda9ea325411 req-97b3bcec-dacf-4d0e-b66e-f9061a09414f service nova] Creating event network-changed:9232a5f7-d95a-44a5-b49d-7664a4d75f80 for instance af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 on hv-cinder-84327 Jun 24 10:04:12.790861 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-316ae2e0-0d39-4e58-8dab-dda9ea325411 req-97b3bcec-dacf-4d0e-b66e-f9061a09414f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051961 Jun 24 10:04:12.792579 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 213/436] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:04:13.329596 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-c9e24cbc-09a5-493f-b25e-79de1298ce75 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:13.330871 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-c9e24cbc-09a5-493f-b25e-79de1298ce75 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:13.351967 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c9e24cbc-09a5-493f-b25e-79de1298ce75 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:13.353123 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c9e24cbc-09a5-493f-b25e-79de1298ce75 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:13.356759 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c9e24cbc-09a5-493f-b25e-79de1298ce75 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:13.357783 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c9e24cbc-09a5-493f-b25e-79de1298ce75 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:13.551450 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-223c024b-b72b-4c5b-b2b5-4386baa8d5a3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:13.552450 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-223c024b-b72b-4c5b-b2b5-4386baa8d5a3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:13.577093 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-223c024b-b72b-4c5b-b2b5-4386baa8d5a3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:13.583819 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-223c024b-b72b-4c5b-b2b5-4386baa8d5a3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:13.583819 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-223c024b-b72b-4c5b-b2b5-4386baa8d5a3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:13.583819 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-223c024b-b72b-4c5b-b2b5-4386baa8d5a3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:13.869809 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-c9e24cbc-09a5-493f-b25e-79de1298ce75 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:13.890547 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-c9e24cbc-09a5-493f-b25e-79de1298ce75 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1358 microversion: 2.1 time: 0.563285 Jun 24 10:04:13.896742 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 224/437] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:13 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1358 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:14.026929 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-223c024b-b72b-4c5b-b2b5-4386baa8d5a3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:14.037333 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-223c024b-b72b-4c5b-b2b5-4386baa8d5a3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:14.054125 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-223c024b-b72b-4c5b-b2b5-4386baa8d5a3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:14.056829 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-223c024b-b72b-4c5b-b2b5-4386baa8d5a3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1748 microversion: 2.20 time: 0.511539 Jun 24 10:04:14.070509 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 214/438] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:13 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1748 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:14.915757 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-03609066-6751-48d9-9397-48f6d8759abd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:14.915757 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-03609066-6751-48d9-9397-48f6d8759abd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:14.915757 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell0:SELECT=2 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:04:14.915757 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell0:SELECT=10 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:04:14.926527 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-03609066-6751-48d9-9397-48f6d8759abd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:14.927382 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-03609066-6751-48d9-9397-48f6d8759abd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:14.941458 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-03609066-6751-48d9-9397-48f6d8759abd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:14.941914 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-03609066-6751-48d9-9397-48f6d8759abd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:15.077955 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-fec48078-1dd4-480b-a909-7ee0fbe0c1cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:15.079351 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-fec48078-1dd4-480b-a909-7ee0fbe0c1cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:15.091700 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-fec48078-1dd4-480b-a909-7ee0fbe0c1cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:15.092451 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-fec48078-1dd4-480b-a909-7ee0fbe0c1cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:15.102582 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-fec48078-1dd4-480b-a909-7ee0fbe0c1cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:15.103040 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-fec48078-1dd4-480b-a909-7ee0fbe0c1cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:15.242440 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-03609066-6751-48d9-9397-48f6d8759abd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:15.256695 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-03609066-6751-48d9-9397-48f6d8759abd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1358 microversion: 2.1 time: 0.349257 Jun 24 10:04:15.259330 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 225/439] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:14 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1358 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:15.381512 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-fec48078-1dd4-480b-a909-7ee0fbe0c1cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:15.392205 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-fec48078-1dd4-480b-a909-7ee0fbe0c1cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:15.393750 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-fec48078-1dd4-480b-a909-7ee0fbe0c1cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:15.404750 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-fec48078-1dd4-480b-a909-7ee0fbe0c1cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1748 microversion: 2.20 time: 0.330664 Jun 24 10:04:15.405352 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 215/440] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:15 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1748 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:04:16.294068 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-5b1392f1-281d-43d8-9c2e-63f4cd8e45f0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:16.312617 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-5b1392f1-281d-43d8-9c2e-63f4cd8e45f0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:16.328244 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5b1392f1-281d-43d8-9c2e-63f4cd8e45f0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:16.328703 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5b1392f1-281d-43d8-9c2e-63f4cd8e45f0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:16.329481 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5b1392f1-281d-43d8-9c2e-63f4cd8e45f0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:16.356592 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5b1392f1-281d-43d8-9c2e-63f4cd8e45f0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:16.432948 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-20414027-fb79-4f6e-873a-25875a0bc7ba tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:16.434498 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-20414027-fb79-4f6e-873a-25875a0bc7ba tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:16.445264 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell0:SELECT=4 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:04:16.457658 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-20414027-fb79-4f6e-873a-25875a0bc7ba tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:16.458248 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-20414027-fb79-4f6e-873a-25875a0bc7ba tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:16.459222 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-20414027-fb79-4f6e-873a-25875a0bc7ba tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:16.459699 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-20414027-fb79-4f6e-873a-25875a0bc7ba tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:16.733925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-5b1392f1-281d-43d8-9c2e-63f4cd8e45f0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:16.746113 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-5b1392f1-281d-43d8-9c2e-63f4cd8e45f0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1358 microversion: 2.1 time: 0.474851 Jun 24 10:04:16.756736 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 226/441] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:16 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1358 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:16.810808 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-20414027-fb79-4f6e-873a-25875a0bc7ba tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:16.828596 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-20414027-fb79-4f6e-873a-25875a0bc7ba tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:16.832652 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-20414027-fb79-4f6e-873a-25875a0bc7ba tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:16.833193 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-20414027-fb79-4f6e-873a-25875a0bc7ba tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1748 microversion: 2.20 time: 0.409687 Jun 24 10:04:16.834475 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 216/442] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:16 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1748 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:17.763602 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-e3977751-5b0a-402d-9289-7f7fc076cce6 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:17.764287 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-e3977751-5b0a-402d-9289-7f7fc076cce6 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:17.770948 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e3977751-5b0a-402d-9289-7f7fc076cce6 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:17.773149 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e3977751-5b0a-402d-9289-7f7fc076cce6 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:17.773149 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e3977751-5b0a-402d-9289-7f7fc076cce6 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:17.773149 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e3977751-5b0a-402d-9289-7f7fc076cce6 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:17.853932 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-ef5ee9f6-26ff-4d49-91e5-eb5ae6fb745e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:17.854534 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-ef5ee9f6-26ff-4d49-91e5-eb5ae6fb745e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:17.868630 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ef5ee9f6-26ff-4d49-91e5-eb5ae6fb745e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:17.868630 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ef5ee9f6-26ff-4d49-91e5-eb5ae6fb745e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:17.868630 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ef5ee9f6-26ff-4d49-91e5-eb5ae6fb745e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:17.868630 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ef5ee9f6-26ff-4d49-91e5-eb5ae6fb745e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:17.920734 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-e3977751-5b0a-402d-9289-7f7fc076cce6 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:17.936485 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-e3977751-5b0a-402d-9289-7f7fc076cce6 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1358 microversion: 2.1 time: 0.175769 Jun 24 10:04:17.954094 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 227/443] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:17 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:18.033011 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-ef5ee9f6-26ff-4d49-91e5-eb5ae6fb745e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:18.042821 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-ef5ee9f6-26ff-4d49-91e5-eb5ae6fb745e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:18.044362 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-ef5ee9f6-26ff-4d49-91e5-eb5ae6fb745e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:18.049865 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-ef5ee9f6-26ff-4d49-91e5-eb5ae6fb745e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1748 microversion: 2.20 time: 0.199699 Jun 24 10:04:18.053723 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 217/444] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:17 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1748 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:04:18.955002 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-f98756d5-718e-4557-96fc-f45bdeec54d5 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:18.956486 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-f98756d5-718e-4557-96fc-f45bdeec54d5 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:18.964109 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f98756d5-718e-4557-96fc-f45bdeec54d5 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:18.964880 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f98756d5-718e-4557-96fc-f45bdeec54d5 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:18.965906 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f98756d5-718e-4557-96fc-f45bdeec54d5 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:18.966639 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f98756d5-718e-4557-96fc-f45bdeec54d5 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:19.070717 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-91f1b994-4a07-4457-9769-016d21726a92 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:19.075545 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-91f1b994-4a07-4457-9769-016d21726a92 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:19.083892 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-91f1b994-4a07-4457-9769-016d21726a92 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:19.084763 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-91f1b994-4a07-4457-9769-016d21726a92 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:19.085800 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-91f1b994-4a07-4457-9769-016d21726a92 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:19.086486 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-91f1b994-4a07-4457-9769-016d21726a92 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:19.174659 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-f98756d5-718e-4557-96fc-f45bdeec54d5 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:19.184266 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-f98756d5-718e-4557-96fc-f45bdeec54d5 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1358 microversion: 2.1 time: 0.233160 Jun 24 10:04:19.185490 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 228/445] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:18 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:04:19.273622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-91f1b994-4a07-4457-9769-016d21726a92 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:19.284764 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-91f1b994-4a07-4457-9769-016d21726a92 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:19.286689 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-91f1b994-4a07-4457-9769-016d21726a92 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:19.288293 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-91f1b994-4a07-4457-9769-016d21726a92 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1748 microversion: 2.20 time: 0.221365 Jun 24 10:04:19.289714 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 218/446] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:19 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1748 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:20.203462 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-d1db9001-ccc2-4968-89e0-035a0d65ccb0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:20.204110 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-d1db9001-ccc2-4968-89e0-035a0d65ccb0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:20.213451 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d1db9001-ccc2-4968-89e0-035a0d65ccb0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:20.214615 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d1db9001-ccc2-4968-89e0-035a0d65ccb0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:20.216026 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d1db9001-ccc2-4968-89e0-035a0d65ccb0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:20.216843 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d1db9001-ccc2-4968-89e0-035a0d65ccb0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:20.307800 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-57ad8a5e-a932-4650-bd03-721d0238d9cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:20.308594 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-57ad8a5e-a932-4650-bd03-721d0238d9cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:20.328026 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-57ad8a5e-a932-4650-bd03-721d0238d9cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:20.328521 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-57ad8a5e-a932-4650-bd03-721d0238d9cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:20.332778 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-57ad8a5e-a932-4650-bd03-721d0238d9cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:20.333230 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-57ad8a5e-a932-4650-bd03-721d0238d9cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:20.418052 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d1db9001-ccc2-4968-89e0-035a0d65ccb0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:20.429462 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-d1db9001-ccc2-4968-89e0-035a0d65ccb0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1358 microversion: 2.1 time: 0.229639 Jun 24 10:04:20.440779 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 229/447] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:20 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:20.592730 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-57ad8a5e-a932-4650-bd03-721d0238d9cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:20.636818 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-57ad8a5e-a932-4650-bd03-721d0238d9cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:20.638908 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-57ad8a5e-a932-4650-bd03-721d0238d9cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:20.640450 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-57ad8a5e-a932-4650-bd03-721d0238d9cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1748 microversion: 2.20 time: 0.337306 Jun 24 10:04:20.662338 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 219/448] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:20 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1748 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:21.457565 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-9066d7f6-4f76-4d72-9217-9c1f78191b22 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:21.460657 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-9066d7f6-4f76-4d72-9217-9c1f78191b22 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:21.479369 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9066d7f6-4f76-4d72-9217-9c1f78191b22 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:21.480503 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9066d7f6-4f76-4d72-9217-9c1f78191b22 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:21.481229 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9066d7f6-4f76-4d72-9217-9c1f78191b22 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:21.481676 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9066d7f6-4f76-4d72-9217-9c1f78191b22 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:21.684940 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-2df58025-72ce-4cdf-b6e6-23b8e888f11e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:21.685607 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-2df58025-72ce-4cdf-b6e6-23b8e888f11e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:21.700425 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2df58025-72ce-4cdf-b6e6-23b8e888f11e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:21.700883 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2df58025-72ce-4cdf-b6e6-23b8e888f11e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:21.701670 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2df58025-72ce-4cdf-b6e6-23b8e888f11e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:21.709128 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2df58025-72ce-4cdf-b6e6-23b8e888f11e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:21.770454 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-9066d7f6-4f76-4d72-9217-9c1f78191b22 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:21.779477 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:04:21.797212 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-9066d7f6-4f76-4d72-9217-9c1f78191b22 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1358 microversion: 2.1 time: 0.349485 Jun 24 10:04:21.805194 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 230/449] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:21 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1358 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:21.912410 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2df58025-72ce-4cdf-b6e6-23b8e888f11e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:21.922502 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2df58025-72ce-4cdf-b6e6-23b8e888f11e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:21.924293 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2df58025-72ce-4cdf-b6e6-23b8e888f11e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:21.925695 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-2df58025-72ce-4cdf-b6e6-23b8e888f11e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1748 microversion: 2.20 time: 0.254169 Jun 24 10:04:21.926417 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 220/450] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:21 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1748 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:22.821948 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-2ad77666-5b6f-45c0-9d14-35aa79586569 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:22.821948 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-2ad77666-5b6f-45c0-9d14-35aa79586569 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:22.865796 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2ad77666-5b6f-45c0-9d14-35aa79586569 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:22.866697 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2ad77666-5b6f-45c0-9d14-35aa79586569 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:22.874059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2ad77666-5b6f-45c0-9d14-35aa79586569 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:22.878182 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2ad77666-5b6f-45c0-9d14-35aa79586569 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:22.947873 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-ff50f1ed-24c9-441a-8e2a-dd679a1a491e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:22.949587 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-ff50f1ed-24c9-441a-8e2a-dd679a1a491e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:22.956932 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ff50f1ed-24c9-441a-8e2a-dd679a1a491e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:22.957713 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ff50f1ed-24c9-441a-8e2a-dd679a1a491e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:22.958861 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ff50f1ed-24c9-441a-8e2a-dd679a1a491e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:22.959505 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ff50f1ed-24c9-441a-8e2a-dd679a1a491e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:23.066658 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-2ad77666-5b6f-45c0-9d14-35aa79586569 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:23.075278 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-2ad77666-5b6f-45c0-9d14-35aa79586569 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1358 microversion: 2.1 time: 0.264150 Jun 24 10:04:23.077162 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 231/451] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:22 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1358 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:23.210072 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-ff50f1ed-24c9-441a-8e2a-dd679a1a491e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:23.222661 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-ff50f1ed-24c9-441a-8e2a-dd679a1a491e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:23.224509 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-ff50f1ed-24c9-441a-8e2a-dd679a1a491e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:23.226170 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-ff50f1ed-24c9-441a-8e2a-dd679a1a491e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1748 microversion: 2.20 time: 0.285167 Jun 24 10:04:23.227442 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 221/452] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:22 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1748 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:04:24.094646 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-a9be1249-a1fd-4198-b41c-85f0abe4d07d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:24.096086 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-a9be1249-a1fd-4198-b41c-85f0abe4d07d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:24.105130 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a9be1249-a1fd-4198-b41c-85f0abe4d07d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:24.105892 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a9be1249-a1fd-4198-b41c-85f0abe4d07d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:24.107083 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a9be1249-a1fd-4198-b41c-85f0abe4d07d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:24.107594 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a9be1249-a1fd-4198-b41c-85f0abe4d07d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:24.254892 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-a9be1249-a1fd-4198-b41c-85f0abe4d07d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:24.260845 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-3562a76b-e318-4e83-949a-5581ff4f2a7e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:24.274605 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-a9be1249-a1fd-4198-b41c-85f0abe4d07d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1358 microversion: 2.1 time: 0.172337 Jun 24 10:04:24.275372 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-3562a76b-e318-4e83-949a-5581ff4f2a7e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:24.275463 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 232/453] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:24 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:24.279215 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3562a76b-e318-4e83-949a-5581ff4f2a7e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:24.279973 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3562a76b-e318-4e83-949a-5581ff4f2a7e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:24.281565 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3562a76b-e318-4e83-949a-5581ff4f2a7e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:24.282246 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3562a76b-e318-4e83-949a-5581ff4f2a7e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:24.495305 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-3562a76b-e318-4e83-949a-5581ff4f2a7e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:24.504422 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-3562a76b-e318-4e83-949a-5581ff4f2a7e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:24.506359 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-3562a76b-e318-4e83-949a-5581ff4f2a7e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:24.507738 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-3562a76b-e318-4e83-949a-5581ff4f2a7e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1748 microversion: 2.20 time: 0.266142 Jun 24 10:04:24.519010 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 222/454] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:24 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1748 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:25.277842 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-08b5fa33-94d4-4d61-882a-5d239d19c6fc tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:25.283494 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-08b5fa33-94d4-4d61-882a-5d239d19c6fc tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:25.285032 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-08b5fa33-94d4-4d61-882a-5d239d19c6fc tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:25.285478 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-08b5fa33-94d4-4d61-882a-5d239d19c6fc tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:25.286227 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-08b5fa33-94d4-4d61-882a-5d239d19c6fc tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:25.286657 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-08b5fa33-94d4-4d61-882a-5d239d19c6fc tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:25.424059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-08b5fa33-94d4-4d61-882a-5d239d19c6fc tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:25.431725 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-08b5fa33-94d4-4d61-882a-5d239d19c6fc tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1358 microversion: 2.1 time: 0.157650 Jun 24 10:04:25.432319 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 233/455] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:25 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:25.527091 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-9899e369-235d-4070-ab00-2c92c399c6a9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:25.527635 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-9899e369-235d-4070-ab00-2c92c399c6a9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:25.534172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9899e369-235d-4070-ab00-2c92c399c6a9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:25.534632 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9899e369-235d-4070-ab00-2c92c399c6a9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:25.535396 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9899e369-235d-4070-ab00-2c92c399c6a9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:25.535862 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9899e369-235d-4070-ab00-2c92c399c6a9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:25.691596 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-9899e369-235d-4070-ab00-2c92c399c6a9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:25.700068 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-9899e369-235d-4070-ab00-2c92c399c6a9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:25.701602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-9899e369-235d-4070-ab00-2c92c399c6a9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:25.702761 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-9899e369-235d-4070-ab00-2c92c399c6a9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1748 microversion: 2.20 time: 0.180283 Jun 24 10:04:25.703357 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 223/456] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:25 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1748 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:04:26.448314 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-2f13b228-e025-4566-8c8a-4d32fdcd70dd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:26.452910 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-2f13b228-e025-4566-8c8a-4d32fdcd70dd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:26.455637 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2f13b228-e025-4566-8c8a-4d32fdcd70dd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:26.456095 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2f13b228-e025-4566-8c8a-4d32fdcd70dd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:26.456894 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2f13b228-e025-4566-8c8a-4d32fdcd70dd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:26.457341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2f13b228-e025-4566-8c8a-4d32fdcd70dd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:26.630593 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-2f13b228-e025-4566-8c8a-4d32fdcd70dd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:26.639017 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-2f13b228-e025-4566-8c8a-4d32fdcd70dd tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1358 microversion: 2.1 time: 0.194725 Jun 24 10:04:26.639712 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 234/457] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:26 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:26.728220 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-25382590-c6aa-4509-a8c8-604a87551ba2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:26.728220 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-25382590-c6aa-4509-a8c8-604a87551ba2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:26.731040 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-25382590-c6aa-4509-a8c8-604a87551ba2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:26.731576 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-25382590-c6aa-4509-a8c8-604a87551ba2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:26.732426 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-25382590-c6aa-4509-a8c8-604a87551ba2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:26.732855 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-25382590-c6aa-4509-a8c8-604a87551ba2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:26.895398 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-25382590-c6aa-4509-a8c8-604a87551ba2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:26.905749 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-25382590-c6aa-4509-a8c8-604a87551ba2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:26.909633 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-25382590-c6aa-4509-a8c8-604a87551ba2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:26.911831 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-25382590-c6aa-4509-a8c8-604a87551ba2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1750 microversion: 2.20 time: 0.194503 Jun 24 10:04:26.924397 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 224/458] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:26 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1750 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:26.993388 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-69664d95-403e-4f25-b49f-c8d902f26667 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2828bffb-c5ff-4336-bda3-a98f1e2b3f67"}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:04:26.994781 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-69664d95-403e-4f25-b49f-c8d902f26667 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:27.001612 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-69664d95-403e-4f25-b49f-c8d902f26667 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:27.002058 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-69664d95-403e-4f25-b49f-c8d902f26667 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:27.003010 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-69664d95-403e-4f25-b49f-c8d902f26667 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:27.003445 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-69664d95-403e-4f25-b49f-c8d902f26667 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:27.656968 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-10ff050a-a25f-4943-adbb-07fdbd7da4f2 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:27.662154 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-10ff050a-a25f-4943-adbb-07fdbd7da4f2 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:27.665037 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-10ff050a-a25f-4943-adbb-07fdbd7da4f2 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:27.665493 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-10ff050a-a25f-4943-adbb-07fdbd7da4f2 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:27.666268 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-10ff050a-a25f-4943-adbb-07fdbd7da4f2 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:27.666709 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-10ff050a-a25f-4943-adbb-07fdbd7da4f2 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:27.820955 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-10ff050a-a25f-4943-adbb-07fdbd7da4f2 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:27.828916 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-10ff050a-a25f-4943-adbb-07fdbd7da4f2 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1358 microversion: 2.1 time: 0.176529 Jun 24 10:04:27.829487 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 225/459] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:27 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:27.932535 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-1c762897-656a-4e98-98e0-70e84f5bf9c8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:27.933547 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-1c762897-656a-4e98-98e0-70e84f5bf9c8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:27.944906 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1c762897-656a-4e98-98e0-70e84f5bf9c8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:27.945979 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1c762897-656a-4e98-98e0-70e84f5bf9c8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:27.947128 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1c762897-656a-4e98-98e0-70e84f5bf9c8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:27.947789 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1c762897-656a-4e98-98e0-70e84f5bf9c8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:27.984283 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-69664d95-403e-4f25-b49f-c8d902f26667 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "POST /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.995032 Jun 24 10:04:27.986488 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 235/460] 10.222.0.26 () {60 vars in 1322 bytes} [Fri Jun 24 10:04:26 2022] POST /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716/os-volume_attachments => generated 194 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:04:28.113550 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:04:28.114068 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Fri Jun 24 10:04:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 (ip 10.222.0.26) !!! Jun 24 10:04:28.134239 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-1c762897-656a-4e98-98e0-70e84f5bf9c8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:28.147175 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-1c762897-656a-4e98-98e0-70e84f5bf9c8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:28.147175 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-1c762897-656a-4e98-98e0-70e84f5bf9c8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:28.147405 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-1c762897-656a-4e98-98e0-70e84f5bf9c8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1806 microversion: 2.20 time: 0.220085 Jun 24 10:04:28.148308 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 226/461] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:27 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1806 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:28.846967 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-e97843c9-98c1-4e4e-887f-c1ab0f1ff03e tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:28.847714 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-e97843c9-98c1-4e4e-887f-c1ab0f1ff03e tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:28.855595 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e97843c9-98c1-4e4e-887f-c1ab0f1ff03e tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:28.856040 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e97843c9-98c1-4e4e-887f-c1ab0f1ff03e tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:28.857005 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e97843c9-98c1-4e4e-887f-c1ab0f1ff03e tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:28.857592 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e97843c9-98c1-4e4e-887f-c1ab0f1ff03e tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:29.021889 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-e97843c9-98c1-4e4e-887f-c1ab0f1ff03e tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:29.032291 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-e97843c9-98c1-4e4e-887f-c1ab0f1ff03e tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1358 microversion: 2.1 time: 0.189599 Jun 24 10:04:29.033127 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 236/462] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:28 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:29.166370 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-9ecca7b9-fa9c-4f07-8a4b-9f3906e44eab tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:29.166976 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-9ecca7b9-fa9c-4f07-8a4b-9f3906e44eab tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:29.173752 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9ecca7b9-fa9c-4f07-8a4b-9f3906e44eab tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:29.174199 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9ecca7b9-fa9c-4f07-8a4b-9f3906e44eab tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:29.174962 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9ecca7b9-fa9c-4f07-8a4b-9f3906e44eab tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:29.175394 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9ecca7b9-fa9c-4f07-8a4b-9f3906e44eab tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:29.179631 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:04:29.319172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-9ecca7b9-fa9c-4f07-8a4b-9f3906e44eab tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:29.336934 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-9ecca7b9-fa9c-4f07-8a4b-9f3906e44eab tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:29.340542 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-9ecca7b9-fa9c-4f07-8a4b-9f3906e44eab tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:29.344187 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-9ecca7b9-fa9c-4f07-8a4b-9f3906e44eab tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1806 microversion: 2.20 time: 0.182190 Jun 24 10:04:29.346270 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 227/463] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:29 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1806 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:30.061869 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-fb03d7fe-bd35-4741-a89c-7d0ed6e343b0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:30.067277 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-fb03d7fe-bd35-4741-a89c-7d0ed6e343b0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:30.083384 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fb03d7fe-bd35-4741-a89c-7d0ed6e343b0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:30.084100 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fb03d7fe-bd35-4741-a89c-7d0ed6e343b0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:30.085386 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fb03d7fe-bd35-4741-a89c-7d0ed6e343b0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:30.086658 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fb03d7fe-bd35-4741-a89c-7d0ed6e343b0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:30.366141 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-1567cf8e-1382-4192-92a1-c8122dc2f097 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:30.367565 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-1567cf8e-1382-4192-92a1-c8122dc2f097 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:30.382511 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1567cf8e-1382-4192-92a1-c8122dc2f097 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:30.385793 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1567cf8e-1382-4192-92a1-c8122dc2f097 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:30.388788 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1567cf8e-1382-4192-92a1-c8122dc2f097 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:30.389352 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1567cf8e-1382-4192-92a1-c8122dc2f097 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:30.475627 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-fb03d7fe-bd35-4741-a89c-7d0ed6e343b0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:30.487699 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-fb03d7fe-bd35-4741-a89c-7d0ed6e343b0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1358 microversion: 2.1 time: 0.432010 Jun 24 10:04:30.489976 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 237/464] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:30 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1358 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:30.493257 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-2cb274e3-03cd-4770-81fc-32a0fed07b78 req-63398885-b2fb-4015-9a12-adbee4f9776a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af9804ec-09cf-4bd7-bf69-83dc28a5d1d5", "name": "network-vif-plugged", "status": "completed", "tag": "9232a5f7-d95a-44a5-b49d-7664a4d75f80"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:04:30.502929 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-2cb274e3-03cd-4770-81fc-32a0fed07b78 req-63398885-b2fb-4015-9a12-adbee4f9776a service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:30.503759 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-2cb274e3-03cd-4770-81fc-32a0fed07b78 req-63398885-b2fb-4015-9a12-adbee4f9776a service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:30.519846 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-2cb274e3-03cd-4770-81fc-32a0fed07b78 req-63398885-b2fb-4015-9a12-adbee4f9776a service nova] Creating event network-vif-plugged:9232a5f7-d95a-44a5-b49d-7664a4d75f80 for instance af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 on hv-cinder-84327 Jun 24 10:04:30.525563 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-2cb274e3-03cd-4770-81fc-32a0fed07b78 req-63398885-b2fb-4015-9a12-adbee4f9776a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035760 Jun 24 10:04:30.529212 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 238/465] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:04:30.610365 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-1567cf8e-1382-4192-92a1-c8122dc2f097 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:30.650140 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-1567cf8e-1382-4192-92a1-c8122dc2f097 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:30.654840 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-1567cf8e-1382-4192-92a1-c8122dc2f097 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:30.658820 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-1567cf8e-1382-4192-92a1-c8122dc2f097 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1806 microversion: 2.20 time: 0.294667 Jun 24 10:04:30.664317 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 228/466] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:30 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1806 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:31.506833 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-ec83c248-ee92-4159-bca6-a1fa1e03caaf tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:31.509155 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-ec83c248-ee92-4159-bca6-a1fa1e03caaf tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:31.524713 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ec83c248-ee92-4159-bca6-a1fa1e03caaf tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:31.529254 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ec83c248-ee92-4159-bca6-a1fa1e03caaf tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:31.529254 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ec83c248-ee92-4159-bca6-a1fa1e03caaf tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:31.529254 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ec83c248-ee92-4159-bca6-a1fa1e03caaf tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:31.678781 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-7cd538b8-7faa-4cf7-80e6-084b1eac3bdd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:31.684317 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-7cd538b8-7faa-4cf7-80e6-084b1eac3bdd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:31.687554 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7cd538b8-7faa-4cf7-80e6-084b1eac3bdd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:31.688410 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7cd538b8-7faa-4cf7-80e6-084b1eac3bdd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:31.689381 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7cd538b8-7faa-4cf7-80e6-084b1eac3bdd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:31.690006 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7cd538b8-7faa-4cf7-80e6-084b1eac3bdd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:31.691000 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-ec83c248-ee92-4159-bca6-a1fa1e03caaf tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:31.714848 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-ec83c248-ee92-4159-bca6-a1fa1e03caaf tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1358 microversion: 2.1 time: 0.213471 Jun 24 10:04:31.722683 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 239/467] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:31 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:31.858651 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-7cd538b8-7faa-4cf7-80e6-084b1eac3bdd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:31.879196 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-7cd538b8-7faa-4cf7-80e6-084b1eac3bdd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:31.890394 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-7cd538b8-7faa-4cf7-80e6-084b1eac3bdd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:31.895801 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-7cd538b8-7faa-4cf7-80e6-084b1eac3bdd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1806 microversion: 2.20 time: 0.221735 Jun 24 10:04:31.896935 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 229/468] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:31 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1806 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:04:32.144900 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-c9fe1bea-c770-4939-97b7-9823e8aacb5d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-521072471", "imageRef": "f6b1dddb-2953-41a2-99e3-00aeca441bd9", "flavorRef": "452", "networks": [{"uuid": "27c1f451-5632-4595-bd92-6b71a74a8ba9"}]}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:04:32.205769 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.network.neutron [None req-c9fe1bea-c770-4939-97b7-9823e8aacb5d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] validate_networks() for [('27c1f451-5632-4595-bd92-6b71a74a8ba9', None, None, None, None, None)] {{(pid=124979) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:04:32.885499 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-c9fe1bea-c770-4939-97b7-9823e8aacb5d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Flavor limits 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:04:32.885499 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-c9fe1bea-c770-4939-97b7-9823e8aacb5d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Image limits 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:04:32.885499 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-c9fe1bea-c770-4939-97b7-9823e8aacb5d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Flavor pref 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:04:32.885499 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-c9fe1bea-c770-4939-97b7-9823e8aacb5d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Image pref 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:04:32.885499 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-c9fe1bea-c770-4939-97b7-9823e8aacb5d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:04:32.886946 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c9fe1bea-c770-4939-97b7-9823e8aacb5d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:32.886946 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c9fe1bea-c770-4939-97b7-9823e8aacb5d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:32.886946 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c9fe1bea-c770-4939-97b7-9823e8aacb5d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:32.886946 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c9fe1bea-c770-4939-97b7-9823e8aacb5d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:32.887271 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-c9fe1bea-c770-4939-97b7-9823e8aacb5d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Getting quotas for project 28def10792f645c491f98a134ff71dce. Resources: {'instances', 'cores', 'ram'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:04:32.887271 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-c9fe1bea-c770-4939-97b7-9823e8aacb5d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Getting quotas for user cec38b1840f448e5a585469900801917 and project 28def10792f645c491f98a134ff71dce. Resources: {'instances', 'cores', 'ram'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:04:32.887447 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-a2f1752c-d034-41ee-9603-21860d705925 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:32.887447 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-a2f1752c-d034-41ee-9603-21860d705925 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:32.887919 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-c9fe1bea-c770-4939-97b7-9823e8aacb5d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Going to run 1 instances... {{(pid=124979) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:04:32.887919 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-c9fe1bea-c770-4939-97b7-9823e8aacb5d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: d3972b3f-604a-486b-abef-10ecb7b76c4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6b1dddb-2953-41a2-99e3-00aeca441bd9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124979) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:04:32.888109 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a2f1752c-d034-41ee-9603-21860d705925 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:32.888109 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a2f1752c-d034-41ee-9603-21860d705925 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:32.888109 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a2f1752c-d034-41ee-9603-21860d705925 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:32.888109 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a2f1752c-d034-41ee-9603-21860d705925 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:32.888473 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-a2f1752c-d034-41ee-9603-21860d705925 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:32.899365 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-a2f1752c-d034-41ee-9603-21860d705925 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1358 microversion: 2.1 time: 0.171335 Jun 24 10:04:32.899938 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 230/469] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:32 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:04:32.915619 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-772fa5a9-5185-4f13-b6aa-f4f7b9fcfd14 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:32.916356 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-772fa5a9-5185-4f13-b6aa-f4f7b9fcfd14 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:32.929160 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-772fa5a9-5185-4f13-b6aa-f4f7b9fcfd14 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:32.931146 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-772fa5a9-5185-4f13-b6aa-f4f7b9fcfd14 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:32.937325 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-772fa5a9-5185-4f13-b6aa-f4f7b9fcfd14 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:32.938012 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-772fa5a9-5185-4f13-b6aa-f4f7b9fcfd14 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:33.091521 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-772fa5a9-5185-4f13-b6aa-f4f7b9fcfd14 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:33.100374 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-772fa5a9-5185-4f13-b6aa-f4f7b9fcfd14 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:33.102015 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-772fa5a9-5185-4f13-b6aa-f4f7b9fcfd14 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:33.103267 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-772fa5a9-5185-4f13-b6aa-f4f7b9fcfd14 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1806 microversion: 2.20 time: 0.191765 Jun 24 10:04:33.103840 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 231/470] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:32 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1806 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:04:33.610776 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-c9fe1bea-c770-4939-97b7-9823e8aacb5d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.469600 Jun 24 10:04:33.612105 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 240/471] 10.222.0.26 () {60 vars in 1146 bytes} [Fri Jun 24 10:04:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:04:33.623871 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-d5d1ba92-ef15-4bf4-9351-b347479e7327 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:33.625330 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-d5d1ba92-ef15-4bf4-9351-b347479e7327 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: d3972b3f-604a-486b-abef-10ecb7b76c4d] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:33.755798 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d5d1ba92-ef15-4bf4-9351-b347479e7327 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:33.764292 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-d5d1ba92-ef15-4bf4-9351-b347479e7327 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d" status: 200 len: 1218 microversion: 2.1 time: 0.144865 Jun 24 10:04:33.774843 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 232/472] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:33 2022] GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d => generated 1218 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:33.920534 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-2fd38418-a01a-4d64-bac0-45e626727ea1 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:33.921982 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-2fd38418-a01a-4d64-bac0-45e626727ea1 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:33.935004 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2fd38418-a01a-4d64-bac0-45e626727ea1 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:33.935687 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2fd38418-a01a-4d64-bac0-45e626727ea1 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:33.944821 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2fd38418-a01a-4d64-bac0-45e626727ea1 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:33.948197 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2fd38418-a01a-4d64-bac0-45e626727ea1 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:34.125249 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-a6e1cf61-45cf-4664-bde0-88da7e2988c9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:34.126663 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-a6e1cf61-45cf-4664-bde0-88da7e2988c9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:34.136066 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a6e1cf61-45cf-4664-bde0-88da7e2988c9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:34.137068 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a6e1cf61-45cf-4664-bde0-88da7e2988c9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:34.138276 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a6e1cf61-45cf-4664-bde0-88da7e2988c9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:34.139104 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a6e1cf61-45cf-4664-bde0-88da7e2988c9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:34.170566 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-2fd38418-a01a-4d64-bac0-45e626727ea1 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:34.180612 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-2fd38418-a01a-4d64-bac0-45e626727ea1 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1358 microversion: 2.1 time: 0.266943 Jun 24 10:04:34.181860 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 241/473] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:33 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1358 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:34.327419 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-a6e1cf61-45cf-4664-bde0-88da7e2988c9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:34.341114 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-a6e1cf61-45cf-4664-bde0-88da7e2988c9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:34.341114 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-a6e1cf61-45cf-4664-bde0-88da7e2988c9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:34.341114 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-a6e1cf61-45cf-4664-bde0-88da7e2988c9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1806 microversion: 2.20 time: 0.218841 Jun 24 10:04:34.351002 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 233/474] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:34 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1806 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:34.783858 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-982aa490-bbf9-49d0-90d1-1dc37df800da tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:34.784670 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-982aa490-bbf9-49d0-90d1-1dc37df800da tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: d3972b3f-604a-486b-abef-10ecb7b76c4d] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:34.847800 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-982aa490-bbf9-49d0-90d1-1dc37df800da tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:34.858413 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-982aa490-bbf9-49d0-90d1-1dc37df800da tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d" status: 200 len: 1218 microversion: 2.1 time: 0.080118 Jun 24 10:04:34.859317 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 242/475] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:34 2022] GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:35.198432 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-5c7f8c20-0b65-483c-93f2-ed9f84b880d4 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:35.199301 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-5c7f8c20-0b65-483c-93f2-ed9f84b880d4 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:35.206405 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5c7f8c20-0b65-483c-93f2-ed9f84b880d4 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:35.207125 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5c7f8c20-0b65-483c-93f2-ed9f84b880d4 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:35.208071 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5c7f8c20-0b65-483c-93f2-ed9f84b880d4 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:35.208712 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5c7f8c20-0b65-483c-93f2-ed9f84b880d4 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:35.360939 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-906129b7-abde-4617-a07c-d3e8e18fce35 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:35.362003 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-906129b7-abde-4617-a07c-d3e8e18fce35 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:35.373220 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-5c7f8c20-0b65-483c-93f2-ed9f84b880d4 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:35.373866 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-906129b7-abde-4617-a07c-d3e8e18fce35 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:35.374640 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-906129b7-abde-4617-a07c-d3e8e18fce35 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:35.375779 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-906129b7-abde-4617-a07c-d3e8e18fce35 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:35.379559 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-906129b7-abde-4617-a07c-d3e8e18fce35 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:35.390531 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-5c7f8c20-0b65-483c-93f2-ed9f84b880d4 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1358 microversion: 2.1 time: 0.196188 Jun 24 10:04:35.393153 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 234/476] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:35 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:35.568499 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-906129b7-abde-4617-a07c-d3e8e18fce35 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:35.579163 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-906129b7-abde-4617-a07c-d3e8e18fce35 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:35.580832 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-906129b7-abde-4617-a07c-d3e8e18fce35 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:35.582030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-906129b7-abde-4617-a07c-d3e8e18fce35 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1806 microversion: 2.20 time: 0.225332 Jun 24 10:04:35.587475 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 243/477] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:35 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1806 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:35.877278 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-72fef02d-049d-438c-88d0-1946c5ef7491 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:35.878161 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-72fef02d-049d-438c-88d0-1946c5ef7491 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: d3972b3f-604a-486b-abef-10ecb7b76c4d] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:35.884651 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-72fef02d-049d-438c-88d0-1946c5ef7491 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:35.885035 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-72fef02d-049d-438c-88d0-1946c5ef7491 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:35.885807 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-72fef02d-049d-438c-88d0-1946c5ef7491 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:35.886248 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-72fef02d-049d-438c-88d0-1946c5ef7491 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:35.962167 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-72fef02d-049d-438c-88d0-1946c5ef7491 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:35.970535 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-72fef02d-049d-438c-88d0-1946c5ef7491 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d" status: 200 len: 1222 microversion: 2.1 time: 0.096999 Jun 24 10:04:35.971408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 235/478] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:35 2022] GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:36.408982 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-fc2bdbb2-bba9-4701-acb9-e1d5f7d89f8f tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:36.409652 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-fc2bdbb2-bba9-4701-acb9-e1d5f7d89f8f tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:36.417205 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fc2bdbb2-bba9-4701-acb9-e1d5f7d89f8f tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:36.418467 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fc2bdbb2-bba9-4701-acb9-e1d5f7d89f8f tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:36.420099 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fc2bdbb2-bba9-4701-acb9-e1d5f7d89f8f tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:36.421399 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fc2bdbb2-bba9-4701-acb9-e1d5f7d89f8f tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:36.581139 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-fc2bdbb2-bba9-4701-acb9-e1d5f7d89f8f tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:36.589090 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-fc2bdbb2-bba9-4701-acb9-e1d5f7d89f8f tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1358 microversion: 2.1 time: 0.184353 Jun 24 10:04:36.590062 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 244/479] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:36 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:36.605609 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-d8880144-ae62-45cc-96a3-c4c5c889a795 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:36.606935 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-d8880144-ae62-45cc-96a3-c4c5c889a795 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:36.613895 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d8880144-ae62-45cc-96a3-c4c5c889a795 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:36.614675 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d8880144-ae62-45cc-96a3-c4c5c889a795 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:36.615689 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d8880144-ae62-45cc-96a3-c4c5c889a795 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:36.616381 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d8880144-ae62-45cc-96a3-c4c5c889a795 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:36.777771 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d8880144-ae62-45cc-96a3-c4c5c889a795 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:36.788506 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d8880144-ae62-45cc-96a3-c4c5c889a795 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:36.790418 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d8880144-ae62-45cc-96a3-c4c5c889a795 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:36.791590 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-d8880144-ae62-45cc-96a3-c4c5c889a795 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1806 microversion: 2.20 time: 0.189818 Jun 24 10:04:36.792166 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 236/480] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:36 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1806 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:36.989233 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-2ac808b9-3364-45ce-8822-23125b0764ae tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:36.989892 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-2ac808b9-3364-45ce-8822-23125b0764ae tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: d3972b3f-604a-486b-abef-10ecb7b76c4d] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:36.996316 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2ac808b9-3364-45ce-8822-23125b0764ae tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:36.996761 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2ac808b9-3364-45ce-8822-23125b0764ae tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:36.997529 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2ac808b9-3364-45ce-8822-23125b0764ae tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:36.997966 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2ac808b9-3364-45ce-8822-23125b0764ae tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:37.062685 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-2ac808b9-3364-45ce-8822-23125b0764ae tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:37.068821 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-2ac808b9-3364-45ce-8822-23125b0764ae tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d" status: 200 len: 1222 microversion: 2.1 time: 0.083405 Jun 24 10:04:37.069726 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 245/481] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:36 2022] GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:37.298342 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-19ede301-f3b6-4e7b-a7ef-0406cf972b81 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:37.304947 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-19ede301-f3b6-4e7b-a7ef-0406cf972b81 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:37.304947 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-19ede301-f3b6-4e7b-a7ef-0406cf972b81 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:37.305176 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-19ede301-f3b6-4e7b-a7ef-0406cf972b81 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:37.305881 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-19ede301-f3b6-4e7b-a7ef-0406cf972b81 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:37.306311 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-19ede301-f3b6-4e7b-a7ef-0406cf972b81 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:37.444560 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.objects.instance [None req-19ede301-f3b6-4e7b-a7ef-0406cf972b81 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lazy-loading 'services' on Instance uuid 84bc600e-1c87-4ba3-9dfa-421ee774e45e {{(pid=124980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:04:37.607698 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-072a1d96-0e2f-4ef6-b817-c978370e3c4d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:37.609286 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-072a1d96-0e2f-4ef6-b817-c978370e3c4d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:37.620503 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-072a1d96-0e2f-4ef6-b817-c978370e3c4d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:37.621424 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-072a1d96-0e2f-4ef6-b817-c978370e3c4d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:37.622701 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-072a1d96-0e2f-4ef6-b817-c978370e3c4d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:37.623562 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-072a1d96-0e2f-4ef6-b817-c978370e3c4d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:37.716099 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-19ede301-f3b6-4e7b-a7ef-0406cf972b81 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "DELETE /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e/os-volume_attachments/f02bea62-3bab-42dc-87ac-e3d9d5d96bd3" status: 202 len: 0 microversion: 2.1 time: 0.421600 Jun 24 10:04:37.717288 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 237/482] 10.222.0.26 () {58 vars in 1415 bytes} [Fri Jun 24 10:04:37 2022] DELETE /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e/os-volume_attachments/f02bea62-3bab-42dc-87ac-e3d9d5d96bd3 => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 10:04:37.794043 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-072a1d96-0e2f-4ef6-b817-c978370e3c4d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:37.803480 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-072a1d96-0e2f-4ef6-b817-c978370e3c4d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1358 microversion: 2.1 time: 0.201206 Jun 24 10:04:37.814025 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 246/483] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:37 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:37.814230 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-b2c040fa-9bce-4bd5-8a2f-7bb522f5e993 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:37.814818 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-b2c040fa-9bce-4bd5-8a2f-7bb522f5e993 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:37.823763 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b2c040fa-9bce-4bd5-8a2f-7bb522f5e993 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:37.824250 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b2c040fa-9bce-4bd5-8a2f-7bb522f5e993 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:37.825128 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b2c040fa-9bce-4bd5-8a2f-7bb522f5e993 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:37.825566 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b2c040fa-9bce-4bd5-8a2f-7bb522f5e993 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:37.979993 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-b2c040fa-9bce-4bd5-8a2f-7bb522f5e993 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:37.988707 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-b2c040fa-9bce-4bd5-8a2f-7bb522f5e993 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:37.990246 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-b2c040fa-9bce-4bd5-8a2f-7bb522f5e993 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:37.991496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-b2c040fa-9bce-4bd5-8a2f-7bb522f5e993 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1806 microversion: 2.20 time: 0.182463 Jun 24 10:04:38.003382 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 238/484] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:37 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1806 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:38.089370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-ff0d6d2c-eff8-4579-8966-a92e75cdcc47 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:38.090253 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-ff0d6d2c-eff8-4579-8966-a92e75cdcc47 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: d3972b3f-604a-486b-abef-10ecb7b76c4d] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:38.097308 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ff0d6d2c-eff8-4579-8966-a92e75cdcc47 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:38.097764 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ff0d6d2c-eff8-4579-8966-a92e75cdcc47 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:38.098599 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ff0d6d2c-eff8-4579-8966-a92e75cdcc47 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:38.099044 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ff0d6d2c-eff8-4579-8966-a92e75cdcc47 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:38.163090 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-ff0d6d2c-eff8-4579-8966-a92e75cdcc47 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:38.172243 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-ff0d6d2c-eff8-4579-8966-a92e75cdcc47 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d" status: 200 len: 1222 microversion: 2.1 time: 0.088143 Jun 24 10:04:38.172978 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 247/485] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:38 2022] GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:38.822394 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-b2211b67-0b58-4274-a77a-925a56d2f9cb tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:38.823091 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-b2211b67-0b58-4274-a77a-925a56d2f9cb tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:38.829940 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b2211b67-0b58-4274-a77a-925a56d2f9cb tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:38.830438 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b2211b67-0b58-4274-a77a-925a56d2f9cb tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:38.831561 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b2211b67-0b58-4274-a77a-925a56d2f9cb tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:38.831728 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b2211b67-0b58-4274-a77a-925a56d2f9cb tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:38.979113 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-b2211b67-0b58-4274-a77a-925a56d2f9cb tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:38.986489 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-b2211b67-0b58-4274-a77a-925a56d2f9cb tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1358 microversion: 2.1 time: 0.168967 Jun 24 10:04:38.987036 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 239/486] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:38 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:39.011345 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-4f8c8ee0-9f86-4223-9324-3a7ad1b8fd67 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:39.012000 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-4f8c8ee0-9f86-4223-9324-3a7ad1b8fd67 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:39.018595 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4f8c8ee0-9f86-4223-9324-3a7ad1b8fd67 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:39.019128 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4f8c8ee0-9f86-4223-9324-3a7ad1b8fd67 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:39.019872 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4f8c8ee0-9f86-4223-9324-3a7ad1b8fd67 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:39.020330 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4f8c8ee0-9f86-4223-9324-3a7ad1b8fd67 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:39.038409 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:04:39.150708 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-4f8c8ee0-9f86-4223-9324-3a7ad1b8fd67 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:39.159014 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-4f8c8ee0-9f86-4223-9324-3a7ad1b8fd67 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:39.160557 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-4f8c8ee0-9f86-4223-9324-3a7ad1b8fd67 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:39.161697 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-4f8c8ee0-9f86-4223-9324-3a7ad1b8fd67 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1806 microversion: 2.20 time: 0.154887 Jun 24 10:04:39.162254 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 248/487] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:39 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:39.190030 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-93a0ffdf-46cd-4e8b-b7f9-562e2511b7a0 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:39.190636 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-93a0ffdf-46cd-4e8b-b7f9-562e2511b7a0 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: d3972b3f-604a-486b-abef-10ecb7b76c4d] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:39.197264 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-93a0ffdf-46cd-4e8b-b7f9-562e2511b7a0 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:39.200691 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-93a0ffdf-46cd-4e8b-b7f9-562e2511b7a0 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:39.200691 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-93a0ffdf-46cd-4e8b-b7f9-562e2511b7a0 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:39.200691 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-93a0ffdf-46cd-4e8b-b7f9-562e2511b7a0 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:39.258331 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-93a0ffdf-46cd-4e8b-b7f9-562e2511b7a0 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:39.265496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-93a0ffdf-46cd-4e8b-b7f9-562e2511b7a0 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d" status: 200 len: 1222 microversion: 2.1 time: 0.079273 Jun 24 10:04:39.266043 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 240/488] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:39 2022] GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:40.007030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-b5d2cf4a-43a9-494d-923f-dc058064ae5d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:40.008160 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-b5d2cf4a-43a9-494d-923f-dc058064ae5d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:40.010538 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:04:40.016168 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b5d2cf4a-43a9-494d-923f-dc058064ae5d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:40.016783 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b5d2cf4a-43a9-494d-923f-dc058064ae5d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:40.017272 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b5d2cf4a-43a9-494d-923f-dc058064ae5d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:40.017719 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b5d2cf4a-43a9-494d-923f-dc058064ae5d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:40.171982 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-b5d2cf4a-43a9-494d-923f-dc058064ae5d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:40.180026 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-b5d2cf4a-43a9-494d-923f-dc058064ae5d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1358 microversion: 2.1 time: 0.179792 Jun 24 10:04:40.180374 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-68a4f144-3a97-4c23-a9cf-314b212cccca tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:40.182395 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 249/489] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:39 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:40.182778 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-68a4f144-3a97-4c23-a9cf-314b212cccca tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:40.189582 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-68a4f144-3a97-4c23-a9cf-314b212cccca tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:40.190034 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-68a4f144-3a97-4c23-a9cf-314b212cccca tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:40.190807 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-68a4f144-3a97-4c23-a9cf-314b212cccca tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:40.191242 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-68a4f144-3a97-4c23-a9cf-314b212cccca tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:40.282036 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-a0c607fa-27da-4c3b-aa84-edc41e16e3a1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:40.282684 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-a0c607fa-27da-4c3b-aa84-edc41e16e3a1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: d3972b3f-604a-486b-abef-10ecb7b76c4d] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:40.290281 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a0c607fa-27da-4c3b-aa84-edc41e16e3a1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:40.290735 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a0c607fa-27da-4c3b-aa84-edc41e16e3a1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:40.292226 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a0c607fa-27da-4c3b-aa84-edc41e16e3a1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:40.292674 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a0c607fa-27da-4c3b-aa84-edc41e16e3a1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:40.325507 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-68a4f144-3a97-4c23-a9cf-314b212cccca tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:40.334533 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-68a4f144-3a97-4c23-a9cf-314b212cccca tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:40.337120 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-68a4f144-3a97-4c23-a9cf-314b212cccca tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:40.338617 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-68a4f144-3a97-4c23-a9cf-314b212cccca tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1806 microversion: 2.20 time: 0.162123 Jun 24 10:04:40.339181 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 241/490] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:40 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:40.356780 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-a0c607fa-27da-4c3b-aa84-edc41e16e3a1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:40.364704 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-a0c607fa-27da-4c3b-aa84-edc41e16e3a1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d" status: 200 len: 1214 microversion: 2.1 time: 0.086499 Jun 24 10:04:40.369777 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 250/491] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:40 2022] GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:04:41.201945 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-9d7c4b25-9a3d-40d1-88d6-4c52f9705511 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:41.201945 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-9d7c4b25-9a3d-40d1-88d6-4c52f9705511 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:41.205787 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9d7c4b25-9a3d-40d1-88d6-4c52f9705511 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:41.206237 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9d7c4b25-9a3d-40d1-88d6-4c52f9705511 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:41.207023 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9d7c4b25-9a3d-40d1-88d6-4c52f9705511 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:41.207455 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9d7c4b25-9a3d-40d1-88d6-4c52f9705511 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:41.344197 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-9d7c4b25-9a3d-40d1-88d6-4c52f9705511 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:41.352726 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-9d7c4b25-9a3d-40d1-88d6-4c52f9705511 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1358 microversion: 2.1 time: 0.158862 Jun 24 10:04:41.353404 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 242/492] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:41 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:41.357447 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-6e1bab5e-36f1-4217-bc72-10010c5d0cd8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:41.358189 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-6e1bab5e-36f1-4217-bc72-10010c5d0cd8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:41.372314 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6e1bab5e-36f1-4217-bc72-10010c5d0cd8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:41.372314 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6e1bab5e-36f1-4217-bc72-10010c5d0cd8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:41.372314 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6e1bab5e-36f1-4217-bc72-10010c5d0cd8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:41.372314 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6e1bab5e-36f1-4217-bc72-10010c5d0cd8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:41.382520 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-78352e98-00fa-4fe2-ab7f-33c735047a7e tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:41.383379 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-78352e98-00fa-4fe2-ab7f-33c735047a7e tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: d3972b3f-604a-486b-abef-10ecb7b76c4d] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:41.391135 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-78352e98-00fa-4fe2-ab7f-33c735047a7e tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:41.391835 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-78352e98-00fa-4fe2-ab7f-33c735047a7e tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:41.392825 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-78352e98-00fa-4fe2-ab7f-33c735047a7e tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:41.395692 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-78352e98-00fa-4fe2-ab7f-33c735047a7e tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:41.464694 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-78352e98-00fa-4fe2-ab7f-33c735047a7e tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:41.472573 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-78352e98-00fa-4fe2-ab7f-33c735047a7e tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d" status: 200 len: 1270 microversion: 2.1 time: 0.094236 Jun 24 10:04:41.473240 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 243/493] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:41 2022] GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d => generated 1270 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:04:41.510129 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-6e1bab5e-36f1-4217-bc72-10010c5d0cd8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:41.519614 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-6e1bab5e-36f1-4217-bc72-10010c5d0cd8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:41.521401 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-6e1bab5e-36f1-4217-bc72-10010c5d0cd8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:41.522568 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-6e1bab5e-36f1-4217-bc72-10010c5d0cd8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1806 microversion: 2.20 time: 0.169350 Jun 24 10:04:41.523176 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 251/494] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:41 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:04:42.217214 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-0fa256e4-a68d-4abf-8ee8-06e65e718dc4 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:04:42.218894 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-0fa256e4-a68d-4abf-8ee8-06e65e718dc4 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:42.221422 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_api:SELECT=66 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:04:42.226985 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0fa256e4-a68d-4abf-8ee8-06e65e718dc4 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:42.227664 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0fa256e4-a68d-4abf-8ee8-06e65e718dc4 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:42.228818 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0fa256e4-a68d-4abf-8ee8-06e65e718dc4 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:42.233560 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0fa256e4-a68d-4abf-8ee8-06e65e718dc4 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:42.233821 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:04:42.256817 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.objects.instance [None req-0fa256e4-a68d-4abf-8ee8-06e65e718dc4 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lazy-loading 'flavor' on Instance uuid c170d532-d8da-4b26-879d-22c7dc180716 {{(pid=124980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:04:42.370973 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-c5d1e2cb-718e-49e6-9196-e57b50b94bf7 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:42.371823 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-c5d1e2cb-718e-49e6-9196-e57b50b94bf7 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:42.379928 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c5d1e2cb-718e-49e6-9196-e57b50b94bf7 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:42.380620 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c5d1e2cb-718e-49e6-9196-e57b50b94bf7 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:42.381596 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c5d1e2cb-718e-49e6-9196-e57b50b94bf7 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:42.382245 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c5d1e2cb-718e-49e6-9196-e57b50b94bf7 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:42.543687 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-c5d1e2cb-718e-49e6-9196-e57b50b94bf7 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:42.552034 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-c5d1e2cb-718e-49e6-9196-e57b50b94bf7 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1548 microversion: 2.1 time: 0.186098 Jun 24 10:04:42.552634 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 252/495] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:42 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1548 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:04:42.558127 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-17f8887d-3d62-4739-bac8-a0c348fbbfa1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:42.558942 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-17f8887d-3d62-4739-bac8-a0c348fbbfa1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: d3972b3f-604a-486b-abef-10ecb7b76c4d] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:42.566520 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-17f8887d-3d62-4739-bac8-a0c348fbbfa1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:42.567187 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-17f8887d-3d62-4739-bac8-a0c348fbbfa1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:42.568682 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-17f8887d-3d62-4739-bac8-a0c348fbbfa1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:42.568914 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-17f8887d-3d62-4739-bac8-a0c348fbbfa1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:42.683339 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-17f8887d-3d62-4739-bac8-a0c348fbbfa1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:42.691035 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-17f8887d-3d62-4739-bac8-a0c348fbbfa1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d" status: 200 len: 1276 microversion: 2.1 time: 0.137240 Jun 24 10:04:42.691595 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 253/496] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:42 2022] GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d => generated 1276 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:42.704761 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-d9533157-d60d-46e8-bd0f-ab3131b38d9e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:42.705548 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-d9533157-d60d-46e8-bd0f-ab3131b38d9e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:42.707370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell0:SELECT=2 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:04:42.713158 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d9533157-d60d-46e8-bd0f-ab3131b38d9e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:42.713855 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d9533157-d60d-46e8-bd0f-ab3131b38d9e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:42.714800 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d9533157-d60d-46e8-bd0f-ab3131b38d9e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:42.715420 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d9533157-d60d-46e8-bd0f-ab3131b38d9e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:42.719281 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-0fa256e4-a68d-4abf-8ee8-06e65e718dc4 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "POST /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716/action" status: 200 len: 32 microversion: 2.1 time: 0.505927 Jun 24 10:04:42.721865 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 244/497] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Jun 24 10:04:42 2022] POST /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716/action => generated 32 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 10:04:42.739577 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-2c8b1f98-6a4e-4591-85f8-bae18f55fefb tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:42.741928 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-2c8b1f98-6a4e-4591-85f8-bae18f55fefb tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:42.750905 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2c8b1f98-6a4e-4591-85f8-bae18f55fefb tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:42.751606 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2c8b1f98-6a4e-4591-85f8-bae18f55fefb tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:42.752955 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2c8b1f98-6a4e-4591-85f8-bae18f55fefb tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:42.753656 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2c8b1f98-6a4e-4591-85f8-bae18f55fefb tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:42.925999 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2c8b1f98-6a4e-4591-85f8-bae18f55fefb tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:42.936245 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-2c8b1f98-6a4e-4591-85f8-bae18f55fefb tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1548 microversion: 2.1 time: 0.211905 Jun 24 10:04:42.936985 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 245/498] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:42 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1548 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:42.943033 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-cce3fe8a-2ea9-4f42-8115-5b87cc8b6b27 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:42.943641 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-cce3fe8a-2ea9-4f42-8115-5b87cc8b6b27 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:42.948210 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d9533157-d60d-46e8-bd0f-ab3131b38d9e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:42.954264 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-cce3fe8a-2ea9-4f42-8115-5b87cc8b6b27 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:42.954800 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-cce3fe8a-2ea9-4f42-8115-5b87cc8b6b27 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:42.955801 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-cce3fe8a-2ea9-4f42-8115-5b87cc8b6b27 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:42.957178 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-cce3fe8a-2ea9-4f42-8115-5b87cc8b6b27 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:42.962295 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d9533157-d60d-46e8-bd0f-ab3131b38d9e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:42.964059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d9533157-d60d-46e8-bd0f-ab3131b38d9e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:42.965454 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-d9533157-d60d-46e8-bd0f-ab3131b38d9e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1806 microversion: 2.20 time: 0.264473 Jun 24 10:04:42.966220 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 254/499] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:42 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1806 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:42.971056 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-d91ea4a1-4fd8-4db7-b4e6-0130e55ef71c tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:42.980337 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d91ea4a1-4fd8-4db7-b4e6-0130e55ef71c tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:42.980337 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-d91ea4a1-4fd8-4db7-b4e6-0130e55ef71c tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Searching by: {'deleted': False, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04'} {{(pid=124979) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 24 10:04:42.984566 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d91ea4a1-4fd8-4db7-b4e6-0130e55ef71c tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:42.985019 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d91ea4a1-4fd8-4db7-b4e6-0130e55ef71c tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:42.985866 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d91ea4a1-4fd8-4db7-b4e6-0130e55ef71c tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:42.986311 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d91ea4a1-4fd8-4db7-b4e6-0130e55ef71c tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:43.084757 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.multi_cell_list [None req-d91ea4a1-4fd8-4db7-b4e6-0130e55ef71c tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124979) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 24 10:04:43.187968 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-cce3fe8a-2ea9-4f42-8115-5b87cc8b6b27 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:43.199300 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-d91ea4a1-4fd8-4db7-b4e6-0130e55ef71c tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.225527 Jun 24 10:04:43.199300 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 255/500] 10.222.0.26 () {58 vars in 1124 bytes} [Fri Jun 24 10:04:42 2022] GET /compute/v2.1/servers => generated 343 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:04:43.199300 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-9729c5e6-a5e2-40a7-8c29-719273d8fd89 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:04:43.200197 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-cce3fe8a-2ea9-4f42-8115-5b87cc8b6b27 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1734 microversion: 2.1 time: 0.262143 Jun 24 10:04:43.200854 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 246/501] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:42 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1734 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:43.205663 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9729c5e6-a5e2-40a7-8c29-719273d8fd89 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:43.206116 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9729c5e6-a5e2-40a7-8c29-719273d8fd89 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:43.220037 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-4d8ac91c-1ed5-4652-b59f-a7d1b764e1d9 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:43.221841 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-4d8ac91c-1ed5-4652-b59f-a7d1b764e1d9 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:43.229533 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4d8ac91c-1ed5-4652-b59f-a7d1b764e1d9 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:43.230086 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4d8ac91c-1ed5-4652-b59f-a7d1b764e1d9 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:43.231235 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4d8ac91c-1ed5-4652-b59f-a7d1b764e1d9 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:43.231735 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4d8ac91c-1ed5-4652-b59f-a7d1b764e1d9 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:43.289194 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-9729c5e6-a5e2-40a7-8c29-719273d8fd89 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Going to try to stop instance {{(pid=124979) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 24 10:04:43.457325 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-4d8ac91c-1ed5-4652-b59f-a7d1b764e1d9 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:43.465311 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-4d8ac91c-1ed5-4652-b59f-a7d1b764e1d9 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1548 microversion: 2.1 time: 0.252921 Jun 24 10:04:43.466369 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 247/502] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:43 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1548 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:43.508997 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-9729c5e6-a5e2-40a7-8c29-719273d8fd89 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "POST /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e/action" status: 202 len: 0 microversion: 2.1 time: 0.312795 Jun 24 10:04:43.511208 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 256/503] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Jun 24 10:04:43 2022] POST /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:04:43.533469 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-5e0cd38d-2d2a-4652-93fe-b6f8fb4ac822 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:43.534872 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-5e0cd38d-2d2a-4652-93fe-b6f8fb4ac822 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:43.543563 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5e0cd38d-2d2a-4652-93fe-b6f8fb4ac822 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:43.544275 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5e0cd38d-2d2a-4652-93fe-b6f8fb4ac822 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:43.546088 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5e0cd38d-2d2a-4652-93fe-b6f8fb4ac822 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:43.547679 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5e0cd38d-2d2a-4652-93fe-b6f8fb4ac822 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:43.710404 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-66264c14-12f1-4981-9719-f06d07796b70 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:43.712425 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-66264c14-12f1-4981-9719-f06d07796b70 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: d3972b3f-604a-486b-abef-10ecb7b76c4d] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:43.738311 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-5e0cd38d-2d2a-4652-93fe-b6f8fb4ac822 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:43.740037 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-66264c14-12f1-4981-9719-f06d07796b70 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:43.740506 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-66264c14-12f1-4981-9719-f06d07796b70 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:43.741188 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-66264c14-12f1-4981-9719-f06d07796b70 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:43.741625 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-66264c14-12f1-4981-9719-f06d07796b70 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:43.746380 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-5e0cd38d-2d2a-4652-93fe-b6f8fb4ac822 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1677 microversion: 2.1 time: 0.216718 Jun 24 10:04:43.747008 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 248/504] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:43 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1677 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:43.939611 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-66264c14-12f1-4981-9719-f06d07796b70 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:43.948106 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-66264c14-12f1-4981-9719-f06d07796b70 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d" status: 200 len: 1318 microversion: 2.1 time: 0.243745 Jun 24 10:04:43.949766 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 257/505] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:43 2022] GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:43.990555 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-fb3fcc80-4e42-499d-8fb5-77ebab1a2fc0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:43.991485 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-fb3fcc80-4e42-499d-8fb5-77ebab1a2fc0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:43.993493 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell0:SELECT=2 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:04:43.999829 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-fb3fcc80-4e42-499d-8fb5-77ebab1a2fc0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:44.001279 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-fb3fcc80-4e42-499d-8fb5-77ebab1a2fc0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:44.002999 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-fb3fcc80-4e42-499d-8fb5-77ebab1a2fc0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:44.003544 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-fb3fcc80-4e42-499d-8fb5-77ebab1a2fc0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:44.147802 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-fb3fcc80-4e42-499d-8fb5-77ebab1a2fc0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:44.157090 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-fb3fcc80-4e42-499d-8fb5-77ebab1a2fc0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:44.158591 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-fb3fcc80-4e42-499d-8fb5-77ebab1a2fc0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:44.159940 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-fb3fcc80-4e42-499d-8fb5-77ebab1a2fc0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1806 microversion: 2.20 time: 0.173170 Jun 24 10:04:44.160675 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 249/506] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:43 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:04:44.195820 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-c754376b-bbee-47cd-80e6-e8e8c78c6182 req-a0a283b7-2550-45d0-942d-8b1833058a96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3972b3f-604a-486b-abef-10ecb7b76c4d", "tag": "e4868241-59b8-4c94-9a71-0b90b713aec0"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:04:44.204288 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-c754376b-bbee-47cd-80e6-e8e8c78c6182 req-a0a283b7-2550-45d0-942d-8b1833058a96 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:44.204739 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-c754376b-bbee-47cd-80e6-e8e8c78c6182 req-a0a283b7-2550-45d0-942d-8b1833058a96 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:44.215759 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-c754376b-bbee-47cd-80e6-e8e8c78c6182 req-a0a283b7-2550-45d0-942d-8b1833058a96 service nova] Creating event network-changed:e4868241-59b8-4c94-9a71-0b90b713aec0 for instance d3972b3f-604a-486b-abef-10ecb7b76c4d on hv-cinder-84327 Jun 24 10:04:44.220607 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-c754376b-bbee-47cd-80e6-e8e8c78c6182 req-a0a283b7-2550-45d0-942d-8b1833058a96 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029859 Jun 24 10:04:44.221372 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 258/507] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:04:44.224349 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-8e4f7dae-825e-4ac9-b178-91dde98e6995 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:44.224971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-8e4f7dae-825e-4ac9-b178-91dde98e6995 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:44.231682 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8e4f7dae-825e-4ac9-b178-91dde98e6995 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:44.232162 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8e4f7dae-825e-4ac9-b178-91dde98e6995 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:44.232924 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8e4f7dae-825e-4ac9-b178-91dde98e6995 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:44.233367 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8e4f7dae-825e-4ac9-b178-91dde98e6995 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:44.379213 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-8e4f7dae-825e-4ac9-b178-91dde98e6995 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:44.388147 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-8e4f7dae-825e-4ac9-b178-91dde98e6995 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1734 microversion: 2.1 time: 0.167973 Jun 24 10:04:44.388911 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 250/508] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:44 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:04:44.764631 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-fd8e24e5-8037-4ec3-aab6-ed33a67fef3d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:44.765331 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-fd8e24e5-8037-4ec3-aab6-ed33a67fef3d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:44.771591 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fd8e24e5-8037-4ec3-aab6-ed33a67fef3d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:44.772039 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fd8e24e5-8037-4ec3-aab6-ed33a67fef3d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:44.772896 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fd8e24e5-8037-4ec3-aab6-ed33a67fef3d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:44.773311 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fd8e24e5-8037-4ec3-aab6-ed33a67fef3d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:44.853429 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell0:SELECT=8 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:04:44.937751 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-fd8e24e5-8037-4ec3-aab6-ed33a67fef3d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:44.946155 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-fd8e24e5-8037-4ec3-aab6-ed33a67fef3d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1677 microversion: 2.1 time: 0.186427 Jun 24 10:04:44.946735 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 259/509] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:44 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1677 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:44.965760 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-e0400d05-805a-4b56-a15f-1d22590d95e7 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:44.966720 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-e0400d05-805a-4b56-a15f-1d22590d95e7 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: d3972b3f-604a-486b-abef-10ecb7b76c4d] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:44.972905 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e0400d05-805a-4b56-a15f-1d22590d95e7 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:44.973363 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e0400d05-805a-4b56-a15f-1d22590d95e7 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:44.974199 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e0400d05-805a-4b56-a15f-1d22590d95e7 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:44.974642 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e0400d05-805a-4b56-a15f-1d22590d95e7 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:45.115776 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-e0400d05-805a-4b56-a15f-1d22590d95e7 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:45.124230 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-e0400d05-805a-4b56-a15f-1d22590d95e7 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d" status: 200 len: 1318 microversion: 2.1 time: 0.162303 Jun 24 10:04:45.124826 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 251/510] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:44 2022] GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:45.178402 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-8ac83b49-fd87-44fb-962b-cbc4c3a1c6e1 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:45.179012 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-8ac83b49-fd87-44fb-962b-cbc4c3a1c6e1 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:45.185588 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8ac83b49-fd87-44fb-962b-cbc4c3a1c6e1 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:45.185964 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8ac83b49-fd87-44fb-962b-cbc4c3a1c6e1 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:45.186740 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8ac83b49-fd87-44fb-962b-cbc4c3a1c6e1 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:45.187177 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8ac83b49-fd87-44fb-962b-cbc4c3a1c6e1 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:45.316447 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-8ac83b49-fd87-44fb-962b-cbc4c3a1c6e1 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:45.325253 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-8ac83b49-fd87-44fb-962b-cbc4c3a1c6e1 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:45.326752 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-8ac83b49-fd87-44fb-962b-cbc4c3a1c6e1 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:45.327908 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-8ac83b49-fd87-44fb-962b-cbc4c3a1c6e1 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1806 microversion: 2.20 time: 0.153491 Jun 24 10:04:45.328490 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 260/511] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:45 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:45.414553 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-14bd1985-19b3-49ee-8346-d266255f7983 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:45.418491 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-14bd1985-19b3-49ee-8346-d266255f7983 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:45.421819 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-14bd1985-19b3-49ee-8346-d266255f7983 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:45.422280 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-14bd1985-19b3-49ee-8346-d266255f7983 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:45.423060 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-14bd1985-19b3-49ee-8346-d266255f7983 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:45.423500 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-14bd1985-19b3-49ee-8346-d266255f7983 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:45.557449 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-26d25038-808f-4687-a15a-dd8521af6f33 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0ea2e0d-4a78-447d-b4b8-342c0acde89c"}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:04:45.558572 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-26d25038-808f-4687-a15a-dd8521af6f33 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:45.561669 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-14bd1985-19b3-49ee-8346-d266255f7983 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:45.564948 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-26d25038-808f-4687-a15a-dd8521af6f33 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:45.565408 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-26d25038-808f-4687-a15a-dd8521af6f33 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:45.566177 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-26d25038-808f-4687-a15a-dd8521af6f33 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:45.566614 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-26d25038-808f-4687-a15a-dd8521af6f33 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:45.569795 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-14bd1985-19b3-49ee-8346-d266255f7983 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1734 microversion: 2.1 time: 0.159009 Jun 24 10:04:45.570997 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 252/512] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:45 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:45.963578 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-b41dea17-7862-4ab3-b28d-764ac0bcf330 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:45.964218 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-b41dea17-7862-4ab3-b28d-764ac0bcf330 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:45.970285 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b41dea17-7862-4ab3-b28d-764ac0bcf330 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:45.970727 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b41dea17-7862-4ab3-b28d-764ac0bcf330 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:45.971459 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b41dea17-7862-4ab3-b28d-764ac0bcf330 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:45.971890 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b41dea17-7862-4ab3-b28d-764ac0bcf330 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:46.099780 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-b41dea17-7862-4ab3-b28d-764ac0bcf330 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:46.107225 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-b41dea17-7862-4ab3-b28d-764ac0bcf330 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1677 microversion: 2.1 time: 0.148032 Jun 24 10:04:46.107782 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 253/513] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:45 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:04:46.140410 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-19cf54a4-7b86-4c13-b599-876049168769 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:46.141019 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-19cf54a4-7b86-4c13-b599-876049168769 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: d3972b3f-604a-486b-abef-10ecb7b76c4d] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:46.147061 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-19cf54a4-7b86-4c13-b599-876049168769 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:46.147512 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-19cf54a4-7b86-4c13-b599-876049168769 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:46.148385 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-19cf54a4-7b86-4c13-b599-876049168769 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:46.150049 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-19cf54a4-7b86-4c13-b599-876049168769 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:46.275570 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-19cf54a4-7b86-4c13-b599-876049168769 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:46.283095 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-19cf54a4-7b86-4c13-b599-876049168769 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d" status: 200 len: 1318 microversion: 2.1 time: 0.146349 Jun 24 10:04:46.283656 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 254/514] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:46 2022] GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:04:46.345887 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-d8cf3578-80a7-414c-9782-1b729fc4335a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:46.346497 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-d8cf3578-80a7-414c-9782-1b729fc4335a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:46.352402 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d8cf3578-80a7-414c-9782-1b729fc4335a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:46.352857 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d8cf3578-80a7-414c-9782-1b729fc4335a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:46.353619 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d8cf3578-80a7-414c-9782-1b729fc4335a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:46.354059 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d8cf3578-80a7-414c-9782-1b729fc4335a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:46.485699 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d8cf3578-80a7-414c-9782-1b729fc4335a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:46.494491 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d8cf3578-80a7-414c-9782-1b729fc4335a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:46.495983 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d8cf3578-80a7-414c-9782-1b729fc4335a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:46.497151 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-d8cf3578-80a7-414c-9782-1b729fc4335a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1806 microversion: 2.20 time: 0.154953 Jun 24 10:04:46.497705 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 255/515] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:46 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:04:46.587556 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-b9d7b897-13a0-43e0-a647-89650c95f8b0 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:46.588192 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-b9d7b897-13a0-43e0-a647-89650c95f8b0 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:46.594299 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b9d7b897-13a0-43e0-a647-89650c95f8b0 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:46.594763 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b9d7b897-13a0-43e0-a647-89650c95f8b0 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:46.595538 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b9d7b897-13a0-43e0-a647-89650c95f8b0 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:46.595979 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b9d7b897-13a0-43e0-a647-89650c95f8b0 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:46.724983 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-b9d7b897-13a0-43e0-a647-89650c95f8b0 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:46.733558 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-b9d7b897-13a0-43e0-a647-89650c95f8b0 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1734 microversion: 2.1 time: 0.149919 Jun 24 10:04:46.734133 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 256/516] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:46 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:04:47.125037 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-7cf4793c-1435-411c-8adf-2c9281a4a80c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:47.125524 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-7cf4793c-1435-411c-8adf-2c9281a4a80c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:47.131553 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7cf4793c-1435-411c-8adf-2c9281a4a80c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:47.131998 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7cf4793c-1435-411c-8adf-2c9281a4a80c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:47.132797 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7cf4793c-1435-411c-8adf-2c9281a4a80c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:47.133242 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7cf4793c-1435-411c-8adf-2c9281a4a80c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:47.289116 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-7cf4793c-1435-411c-8adf-2c9281a4a80c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:47.297773 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-7cf4793c-1435-411c-8adf-2c9281a4a80c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1677 microversion: 2.1 time: 0.177293 Jun 24 10:04:47.298334 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 257/517] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:47 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:47.302721 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-df2ed341-5ab1-458e-8537-5db2b2dac99b tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:47.303330 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-df2ed341-5ab1-458e-8537-5db2b2dac99b tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: d3972b3f-604a-486b-abef-10ecb7b76c4d] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:47.309200 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-df2ed341-5ab1-458e-8537-5db2b2dac99b tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:47.309663 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-df2ed341-5ab1-458e-8537-5db2b2dac99b tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:47.310419 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-df2ed341-5ab1-458e-8537-5db2b2dac99b tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:47.310856 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-df2ed341-5ab1-458e-8537-5db2b2dac99b tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:47.346491 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-26d25038-808f-4687-a15a-dd8521af6f33 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "POST /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.793808 Jun 24 10:04:47.347739 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 261/518] 10.222.0.26 () {60 vars in 1322 bytes} [Fri Jun 24 10:04:45 2022] POST /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5/os-volume_attachments => generated 194 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:04:47.487383 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-df2ed341-5ab1-458e-8537-5db2b2dac99b tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:47.492396 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:04:47.496985 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-df2ed341-5ab1-458e-8537-5db2b2dac99b tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d" status: 200 len: 1318 microversion: 2.1 time: 0.197685 Jun 24 10:04:47.498518 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 258/519] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:47 2022] GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:47.516044 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-9b1f807e-d451-4378-b16e-f64fa4702404 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:47.516885 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-9b1f807e-d451-4378-b16e-f64fa4702404 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:47.523616 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9b1f807e-d451-4378-b16e-f64fa4702404 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:47.524794 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9b1f807e-d451-4378-b16e-f64fa4702404 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:47.525636 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9b1f807e-d451-4378-b16e-f64fa4702404 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:47.526287 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9b1f807e-d451-4378-b16e-f64fa4702404 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:47.667845 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-9b1f807e-d451-4378-b16e-f64fa4702404 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:47.682252 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-9b1f807e-d451-4378-b16e-f64fa4702404 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:47.683760 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-9b1f807e-d451-4378-b16e-f64fa4702404 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:47.684947 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-9b1f807e-d451-4378-b16e-f64fa4702404 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1806 microversion: 2.20 time: 0.173459 Jun 24 10:04:47.685536 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 262/520] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:47 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:47.750812 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-8da9b54a-1590-4070-936d-ad15a1f7bcbc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:47.751459 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-8da9b54a-1590-4070-936d-ad15a1f7bcbc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:47.758799 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8da9b54a-1590-4070-936d-ad15a1f7bcbc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:47.759292 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8da9b54a-1590-4070-936d-ad15a1f7bcbc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:47.760052 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8da9b54a-1590-4070-936d-ad15a1f7bcbc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:47.760508 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8da9b54a-1590-4070-936d-ad15a1f7bcbc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:47.889840 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-8da9b54a-1590-4070-936d-ad15a1f7bcbc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:47.897644 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-8da9b54a-1590-4070-936d-ad15a1f7bcbc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1734 microversion: 2.1 time: 0.150811 Jun 24 10:04:47.898206 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 259/521] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:47 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:48.314609 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-944fea71-fd37-4214-af01-d14c3b4c3575 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:48.315214 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-944fea71-fd37-4214-af01-d14c3b4c3575 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:48.322565 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-944fea71-fd37-4214-af01-d14c3b4c3575 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:48.323021 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-944fea71-fd37-4214-af01-d14c3b4c3575 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:48.323921 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-944fea71-fd37-4214-af01-d14c3b4c3575 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:48.324286 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-944fea71-fd37-4214-af01-d14c3b4c3575 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:48.329554 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:04:48.462961 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-944fea71-fd37-4214-af01-d14c3b4c3575 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:48.472319 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-944fea71-fd37-4214-af01-d14c3b4c3575 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1677 microversion: 2.1 time: 0.159505 Jun 24 10:04:48.472319 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 263/522] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:48 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:04:48.515300 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-8fe0ac7d-4ece-429e-bdd9-8f9fcd9278b0 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:48.515850 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-8fe0ac7d-4ece-429e-bdd9-8f9fcd9278b0 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: d3972b3f-604a-486b-abef-10ecb7b76c4d] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:48.522703 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8fe0ac7d-4ece-429e-bdd9-8f9fcd9278b0 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:48.523160 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8fe0ac7d-4ece-429e-bdd9-8f9fcd9278b0 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:48.523935 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8fe0ac7d-4ece-429e-bdd9-8f9fcd9278b0 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:48.524400 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8fe0ac7d-4ece-429e-bdd9-8f9fcd9278b0 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:48.659649 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-8fe0ac7d-4ece-429e-bdd9-8f9fcd9278b0 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:48.668020 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-8fe0ac7d-4ece-429e-bdd9-8f9fcd9278b0 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d" status: 200 len: 1318 microversion: 2.1 time: 0.157152 Jun 24 10:04:48.668965 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 260/523] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:48 2022] GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:48.702803 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-d2f31016-a5f7-4ece-b5a9-0a2ccddf47e8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:48.703408 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-d2f31016-a5f7-4ece-b5a9-0a2ccddf47e8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:48.709874 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d2f31016-a5f7-4ece-b5a9-0a2ccddf47e8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:48.710345 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d2f31016-a5f7-4ece-b5a9-0a2ccddf47e8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:48.711074 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d2f31016-a5f7-4ece-b5a9-0a2ccddf47e8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:48.712014 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d2f31016-a5f7-4ece-b5a9-0a2ccddf47e8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:48.844478 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d2f31016-a5f7-4ece-b5a9-0a2ccddf47e8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:48.853310 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d2f31016-a5f7-4ece-b5a9-0a2ccddf47e8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:48.854802 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d2f31016-a5f7-4ece-b5a9-0a2ccddf47e8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:48.855953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-d2f31016-a5f7-4ece-b5a9-0a2ccddf47e8 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1806 microversion: 2.20 time: 0.157072 Jun 24 10:04:48.856549 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 264/524] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:48 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:48.913616 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-a5f5f9e5-dea6-40d0-b835-0f863f4ea8be tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:48.914156 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-a5f5f9e5-dea6-40d0-b835-0f863f4ea8be tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:48.921110 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a5f5f9e5-dea6-40d0-b835-0f863f4ea8be tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:48.921555 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a5f5f9e5-dea6-40d0-b835-0f863f4ea8be tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:48.922306 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a5f5f9e5-dea6-40d0-b835-0f863f4ea8be tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:48.922736 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a5f5f9e5-dea6-40d0-b835-0f863f4ea8be tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:49.061206 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-a5f5f9e5-dea6-40d0-b835-0f863f4ea8be tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:49.070348 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-a5f5f9e5-dea6-40d0-b835-0f863f4ea8be tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1734 microversion: 2.1 time: 0.160531 Jun 24 10:04:49.072683 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 261/525] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:48 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:49.487523 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-aa21cef1-0226-4538-ba55-27f7653b7384 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:49.488144 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-aa21cef1-0226-4538-ba55-27f7653b7384 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:49.494968 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-aa21cef1-0226-4538-ba55-27f7653b7384 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:49.495420 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-aa21cef1-0226-4538-ba55-27f7653b7384 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:49.496194 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-aa21cef1-0226-4538-ba55-27f7653b7384 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:49.496624 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-aa21cef1-0226-4538-ba55-27f7653b7384 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:49.624142 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-aa21cef1-0226-4538-ba55-27f7653b7384 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:49.631855 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-aa21cef1-0226-4538-ba55-27f7653b7384 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1677 microversion: 2.1 time: 0.148098 Jun 24 10:04:49.632454 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 265/526] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:49 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:49.685743 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-ab47c557-2a72-4bbe-953b-f3eec013b184 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:49.686364 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-ab47c557-2a72-4bbe-953b-f3eec013b184 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: d3972b3f-604a-486b-abef-10ecb7b76c4d] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:49.692941 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ab47c557-2a72-4bbe-953b-f3eec013b184 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:49.693405 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ab47c557-2a72-4bbe-953b-f3eec013b184 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:49.694173 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ab47c557-2a72-4bbe-953b-f3eec013b184 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:49.694618 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ab47c557-2a72-4bbe-953b-f3eec013b184 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:49.820905 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-ab47c557-2a72-4bbe-953b-f3eec013b184 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:49.828196 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-ab47c557-2a72-4bbe-953b-f3eec013b184 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d" status: 200 len: 1318 microversion: 2.1 time: 0.146385 Jun 24 10:04:49.828755 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 262/527] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:49 2022] GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:49.874514 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-90a51060-90ee-4b72-97ec-0eccf74ed199 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:49.875111 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-90a51060-90ee-4b72-97ec-0eccf74ed199 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:49.880996 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-90a51060-90ee-4b72-97ec-0eccf74ed199 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:49.881436 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-90a51060-90ee-4b72-97ec-0eccf74ed199 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:49.882184 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-90a51060-90ee-4b72-97ec-0eccf74ed199 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:49.882611 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-90a51060-90ee-4b72-97ec-0eccf74ed199 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:50.011428 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-90a51060-90ee-4b72-97ec-0eccf74ed199 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:50.019746 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-90a51060-90ee-4b72-97ec-0eccf74ed199 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:50.021335 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-90a51060-90ee-4b72-97ec-0eccf74ed199 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:50.022436 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-90a51060-90ee-4b72-97ec-0eccf74ed199 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1806 microversion: 2.20 time: 0.151744 Jun 24 10:04:50.022996 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 266/528] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:49 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:50.089854 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-7758d862-47e6-4240-bc8d-b02456a303c1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:50.090465 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-7758d862-47e6-4240-bc8d-b02456a303c1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:50.096553 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7758d862-47e6-4240-bc8d-b02456a303c1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:50.097007 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7758d862-47e6-4240-bc8d-b02456a303c1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:50.097765 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7758d862-47e6-4240-bc8d-b02456a303c1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:50.098205 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7758d862-47e6-4240-bc8d-b02456a303c1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:50.468142 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-7758d862-47e6-4240-bc8d-b02456a303c1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:50.475946 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-7758d862-47e6-4240-bc8d-b02456a303c1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1734 microversion: 2.1 time: 0.390952 Jun 24 10:04:50.476550 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 263/529] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:50 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1734 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:50.649607 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-32f991db-8493-43f1-b250-31162d6bdbca tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:50.650237 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-32f991db-8493-43f1-b250-31162d6bdbca tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:50.656921 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-32f991db-8493-43f1-b250-31162d6bdbca tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:50.657376 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-32f991db-8493-43f1-b250-31162d6bdbca tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:50.658137 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-32f991db-8493-43f1-b250-31162d6bdbca tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:50.658570 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-32f991db-8493-43f1-b250-31162d6bdbca tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:50.782008 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-cfc0d38d-9ca1-4e50-bc5d-956ac50f418a req-11fb0ca3-5ff9-494e-b09b-13c7b5d2f0a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3972b3f-604a-486b-abef-10ecb7b76c4d", "name": "network-vif-plugged", "status": "completed", "tag": "e4868241-59b8-4c94-9a71-0b90b713aec0"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:04:50.791005 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-cfc0d38d-9ca1-4e50-bc5d-956ac50f418a req-11fb0ca3-5ff9-494e-b09b-13c7b5d2f0a5 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:50.791473 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-cfc0d38d-9ca1-4e50-bc5d-956ac50f418a req-11fb0ca3-5ff9-494e-b09b-13c7b5d2f0a5 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:50.801974 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-32f991db-8493-43f1-b250-31162d6bdbca tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:50.803654 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-cfc0d38d-9ca1-4e50-bc5d-956ac50f418a req-11fb0ca3-5ff9-494e-b09b-13c7b5d2f0a5 service nova] Creating event network-vif-plugged:e4868241-59b8-4c94-9a71-0b90b713aec0 for instance d3972b3f-604a-486b-abef-10ecb7b76c4d on hv-cinder-84327 Jun 24 10:04:50.808860 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-cfc0d38d-9ca1-4e50-bc5d-956ac50f418a req-11fb0ca3-5ff9-494e-b09b-13c7b5d2f0a5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031018 Jun 24 10:04:50.809448 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 264/530] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:04:50.809616 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-32f991db-8493-43f1-b250-31162d6bdbca tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1677 microversion: 2.1 time: 0.163843 Jun 24 10:04:50.810370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 267/531] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:50 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:50.845674 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-6f999fff-d211-4b9f-aa16-317f1983161a tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:50.846378 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-6f999fff-d211-4b9f-aa16-317f1983161a tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: d3972b3f-604a-486b-abef-10ecb7b76c4d] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:50.852738 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6f999fff-d211-4b9f-aa16-317f1983161a tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:50.853318 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6f999fff-d211-4b9f-aa16-317f1983161a tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:50.854110 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6f999fff-d211-4b9f-aa16-317f1983161a tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:50.854556 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6f999fff-d211-4b9f-aa16-317f1983161a tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:51.000263 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-6f999fff-d211-4b9f-aa16-317f1983161a tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:51.007825 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-6f999fff-d211-4b9f-aa16-317f1983161a tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d" status: 200 len: 1318 microversion: 2.1 time: 0.166320 Jun 24 10:04:51.009407 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 265/532] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:50 2022] GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:51.041235 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-01e061d0-0747-46b9-97ae-a08273d8cccb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:51.041877 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-01e061d0-0747-46b9-97ae-a08273d8cccb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:51.048214 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-01e061d0-0747-46b9-97ae-a08273d8cccb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:51.048744 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-01e061d0-0747-46b9-97ae-a08273d8cccb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:51.049560 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-01e061d0-0747-46b9-97ae-a08273d8cccb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:51.049990 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-01e061d0-0747-46b9-97ae-a08273d8cccb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:51.234444 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-01e061d0-0747-46b9-97ae-a08273d8cccb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:51.244949 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-01e061d0-0747-46b9-97ae-a08273d8cccb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:51.246459 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-01e061d0-0747-46b9-97ae-a08273d8cccb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:51.247663 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-01e061d0-0747-46b9-97ae-a08273d8cccb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1806 microversion: 2.20 time: 0.210434 Jun 24 10:04:51.248250 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 268/533] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:51 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1806 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:51.493330 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-e5aaf0ea-8239-4552-9ced-a1e581652282 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:51.493852 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-e5aaf0ea-8239-4552-9ced-a1e581652282 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:51.500000 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e5aaf0ea-8239-4552-9ced-a1e581652282 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:51.500489 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e5aaf0ea-8239-4552-9ced-a1e581652282 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:51.501258 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e5aaf0ea-8239-4552-9ced-a1e581652282 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:51.501703 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e5aaf0ea-8239-4552-9ced-a1e581652282 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:51.631767 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-e5aaf0ea-8239-4552-9ced-a1e581652282 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:51.640347 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-e5aaf0ea-8239-4552-9ced-a1e581652282 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1734 microversion: 2.1 time: 0.151622 Jun 24 10:04:51.640917 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 266/534] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:51 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:51.827218 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-a0a0ed2e-76fc-4783-8808-619a5d701ae2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:51.827829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-a0a0ed2e-76fc-4783-8808-619a5d701ae2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:51.834368 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a0a0ed2e-76fc-4783-8808-619a5d701ae2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:51.834821 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a0a0ed2e-76fc-4783-8808-619a5d701ae2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:51.835579 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a0a0ed2e-76fc-4783-8808-619a5d701ae2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:51.836012 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a0a0ed2e-76fc-4783-8808-619a5d701ae2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:51.965018 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-a0a0ed2e-76fc-4783-8808-619a5d701ae2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:51.972385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-a0a0ed2e-76fc-4783-8808-619a5d701ae2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1677 microversion: 2.1 time: 0.149000 Jun 24 10:04:51.972952 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 269/535] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:51 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:52.024427 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-4af8ea4a-2d25-4340-9fca-8ad8e124fb0b tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:52.025043 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-4af8ea4a-2d25-4340-9fca-8ad8e124fb0b tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: d3972b3f-604a-486b-abef-10ecb7b76c4d] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:52.031406 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4af8ea4a-2d25-4340-9fca-8ad8e124fb0b tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:52.031856 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4af8ea4a-2d25-4340-9fca-8ad8e124fb0b tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:52.032695 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4af8ea4a-2d25-4340-9fca-8ad8e124fb0b tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:52.033124 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4af8ea4a-2d25-4340-9fca-8ad8e124fb0b tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:52.161071 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-4af8ea4a-2d25-4340-9fca-8ad8e124fb0b tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:52.169386 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-4af8ea4a-2d25-4340-9fca-8ad8e124fb0b tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d" status: 200 len: 1318 microversion: 2.1 time: 0.148735 Jun 24 10:04:52.169962 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 267/536] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:52 2022] GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:52.265291 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-6e297a68-401f-4fc7-b847-60e555085aad tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:52.265892 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-6e297a68-401f-4fc7-b847-60e555085aad tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:52.271831 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6e297a68-401f-4fc7-b847-60e555085aad tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:52.272314 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6e297a68-401f-4fc7-b847-60e555085aad tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:52.273064 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6e297a68-401f-4fc7-b847-60e555085aad tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:52.273492 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6e297a68-401f-4fc7-b847-60e555085aad tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:52.402858 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-6e297a68-401f-4fc7-b847-60e555085aad tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:52.411123 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-6e297a68-401f-4fc7-b847-60e555085aad tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:52.412638 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-6e297a68-401f-4fc7-b847-60e555085aad tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:52.413777 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-6e297a68-401f-4fc7-b847-60e555085aad tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1806 microversion: 2.20 time: 0.152368 Jun 24 10:04:52.414329 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 270/537] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:52 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:52.657708 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-cc2b7899-07e6-4fb9-a255-c53dd41468f4 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:52.658350 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-cc2b7899-07e6-4fb9-a255-c53dd41468f4 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:52.664504 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-cc2b7899-07e6-4fb9-a255-c53dd41468f4 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:52.665611 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-cc2b7899-07e6-4fb9-a255-c53dd41468f4 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:52.666687 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-cc2b7899-07e6-4fb9-a255-c53dd41468f4 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:52.666947 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-cc2b7899-07e6-4fb9-a255-c53dd41468f4 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:52.796815 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-cc2b7899-07e6-4fb9-a255-c53dd41468f4 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:52.804730 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-cc2b7899-07e6-4fb9-a255-c53dd41468f4 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1734 microversion: 2.1 time: 0.151237 Jun 24 10:04:52.805292 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 268/538] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:52 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:52.824818 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-1354171c-a20b-4af9-9dd4-c3acf12c9708 req-3afc1849-869a-4db1-bef4-297776a9d43f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "904eb348-521e-499e-8127-cb3096230877", "name": "network-vif-plugged", "status": "completed", "tag": "bc68c0d7-3cc3-4add-8d35-8b1892ac129e"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:04:52.833301 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-1354171c-a20b-4af9-9dd4-c3acf12c9708 req-3afc1849-869a-4db1-bef4-297776a9d43f service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:52.833827 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-1354171c-a20b-4af9-9dd4-c3acf12c9708 req-3afc1849-869a-4db1-bef4-297776a9d43f service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:52.845048 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-1354171c-a20b-4af9-9dd4-c3acf12c9708 req-3afc1849-869a-4db1-bef4-297776a9d43f service nova] Creating event network-vif-plugged:bc68c0d7-3cc3-4add-8d35-8b1892ac129e for instance 904eb348-521e-499e-8127-cb3096230877 on hv-cinder-84327 Jun 24 10:04:52.849670 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-1354171c-a20b-4af9-9dd4-c3acf12c9708 req-3afc1849-869a-4db1-bef4-297776a9d43f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028982 Jun 24 10:04:52.850255 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 271/539] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:04:52.989818 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-2574f540-b386-41dd-accb-86b010d79360 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:52.990355 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-2574f540-b386-41dd-accb-86b010d79360 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:52.996441 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2574f540-b386-41dd-accb-86b010d79360 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:52.996895 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2574f540-b386-41dd-accb-86b010d79360 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:52.997662 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2574f540-b386-41dd-accb-86b010d79360 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:52.998125 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2574f540-b386-41dd-accb-86b010d79360 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:53.127401 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2574f540-b386-41dd-accb-86b010d79360 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:53.135469 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-2574f540-b386-41dd-accb-86b010d79360 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1677 microversion: 2.1 time: 0.149635 Jun 24 10:04:53.136032 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 269/540] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:52 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:53.184681 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell0:SELECT=2 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:04:53.188885 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-2a1b8162-6fac-44f7-9ab1-e65c700ea593 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:53.189561 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-2a1b8162-6fac-44f7-9ab1-e65c700ea593 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: d3972b3f-604a-486b-abef-10ecb7b76c4d] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:53.195561 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2a1b8162-6fac-44f7-9ab1-e65c700ea593 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:53.196654 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2a1b8162-6fac-44f7-9ab1-e65c700ea593 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:53.197574 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2a1b8162-6fac-44f7-9ab1-e65c700ea593 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:53.198002 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2a1b8162-6fac-44f7-9ab1-e65c700ea593 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:53.328523 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-2a1b8162-6fac-44f7-9ab1-e65c700ea593 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:53.335950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-2a1b8162-6fac-44f7-9ab1-e65c700ea593 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d" status: 200 len: 1508 microversion: 2.1 time: 0.152199 Jun 24 10:04:53.336549 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 272/541] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:53 2022] GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:53.433512 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-b182bcf9-581b-4036-a18c-bcb36cf9b194 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:53.435117 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-b182bcf9-581b-4036-a18c-bcb36cf9b194 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:53.440385 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b182bcf9-581b-4036-a18c-bcb36cf9b194 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:53.440839 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b182bcf9-581b-4036-a18c-bcb36cf9b194 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:53.441607 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b182bcf9-581b-4036-a18c-bcb36cf9b194 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:53.442081 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b182bcf9-581b-4036-a18c-bcb36cf9b194 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:53.581554 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-b182bcf9-581b-4036-a18c-bcb36cf9b194 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:53.591503 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-b182bcf9-581b-4036-a18c-bcb36cf9b194 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:53.593024 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-b182bcf9-581b-4036-a18c-bcb36cf9b194 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:53.594179 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-b182bcf9-581b-4036-a18c-bcb36cf9b194 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1806 microversion: 2.20 time: 0.165314 Jun 24 10:04:53.594752 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 270/542] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:53 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:53.822663 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-0f8fc1db-b74a-4746-a00e-850198a2c975 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:53.825477 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-0f8fc1db-b74a-4746-a00e-850198a2c975 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:53.830410 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0f8fc1db-b74a-4746-a00e-850198a2c975 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:53.831156 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0f8fc1db-b74a-4746-a00e-850198a2c975 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:53.832454 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0f8fc1db-b74a-4746-a00e-850198a2c975 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:53.833190 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0f8fc1db-b74a-4746-a00e-850198a2c975 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:54.003069 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-0f8fc1db-b74a-4746-a00e-850198a2c975 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:54.011090 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-0f8fc1db-b74a-4746-a00e-850198a2c975 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1734 microversion: 2.1 time: 0.193123 Jun 24 10:04:54.011653 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 273/543] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:53 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1734 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:54.152774 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-84d24908-759b-4941-b8e8-bfd73b37d442 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:54.153392 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-84d24908-759b-4941-b8e8-bfd73b37d442 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:54.159974 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-84d24908-759b-4941-b8e8-bfd73b37d442 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:54.160450 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-84d24908-759b-4941-b8e8-bfd73b37d442 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:54.161208 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-84d24908-759b-4941-b8e8-bfd73b37d442 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:54.161641 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-84d24908-759b-4941-b8e8-bfd73b37d442 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:54.297511 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-84d24908-759b-4941-b8e8-bfd73b37d442 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:54.305096 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-84d24908-759b-4941-b8e8-bfd73b37d442 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1677 microversion: 2.1 time: 0.156720 Jun 24 10:04:54.305701 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 271/544] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:54 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:54.614804 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-91ea70eb-48d4-458d-99b1-6e1972c0e532 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:54.616351 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-91ea70eb-48d4-458d-99b1-6e1972c0e532 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:54.625822 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-91ea70eb-48d4-458d-99b1-6e1972c0e532 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:54.626318 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-91ea70eb-48d4-458d-99b1-6e1972c0e532 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:54.627401 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-91ea70eb-48d4-458d-99b1-6e1972c0e532 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:54.629946 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-91ea70eb-48d4-458d-99b1-6e1972c0e532 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:54.772323 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-91ea70eb-48d4-458d-99b1-6e1972c0e532 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:54.782735 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-91ea70eb-48d4-458d-99b1-6e1972c0e532 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:54.784260 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-91ea70eb-48d4-458d-99b1-6e1972c0e532 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:54.785638 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-91ea70eb-48d4-458d-99b1-6e1972c0e532 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1806 microversion: 2.20 time: 0.174707 Jun 24 10:04:54.789543 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 274/545] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:54 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:55.027461 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-82fea0b5-aaa8-4d67-952c-1d1e2ef947cc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:55.027983 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-82fea0b5-aaa8-4d67-952c-1d1e2ef947cc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:55.034125 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-82fea0b5-aaa8-4d67-952c-1d1e2ef947cc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:55.034576 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-82fea0b5-aaa8-4d67-952c-1d1e2ef947cc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:55.035335 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-82fea0b5-aaa8-4d67-952c-1d1e2ef947cc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:55.035775 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-82fea0b5-aaa8-4d67-952c-1d1e2ef947cc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:55.174880 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-82fea0b5-aaa8-4d67-952c-1d1e2ef947cc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:55.183842 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-82fea0b5-aaa8-4d67-952c-1d1e2ef947cc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1734 microversion: 2.1 time: 0.160460 Jun 24 10:04:55.184468 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 272/546] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:55 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:55.322383 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-f4be59f2-a9dc-44a5-954e-565ab4252452 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:55.323393 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-f4be59f2-a9dc-44a5-954e-565ab4252452 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:55.330726 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f4be59f2-a9dc-44a5-954e-565ab4252452 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:55.331164 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f4be59f2-a9dc-44a5-954e-565ab4252452 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:55.331962 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f4be59f2-a9dc-44a5-954e-565ab4252452 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:55.332417 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f4be59f2-a9dc-44a5-954e-565ab4252452 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:55.470343 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-f4be59f2-a9dc-44a5-954e-565ab4252452 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:55.479282 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-f4be59f2-a9dc-44a5-954e-565ab4252452 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1654 microversion: 2.1 time: 0.161210 Jun 24 10:04:55.479849 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 275/547] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:55 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1654 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:55.495361 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-576b0c1f-e633-481b-8fd4-a759ec818b6c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:04:55.501819 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-576b0c1f-e633-481b-8fd4-a759ec818b6c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:55.505423 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-576b0c1f-e633-481b-8fd4-a759ec818b6c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:55.524550 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-576b0c1f-e633-481b-8fd4-a759ec818b6c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Going to try to start instance {{(pid=124980) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 24 10:04:55.753652 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-576b0c1f-e633-481b-8fd4-a759ec818b6c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "POST /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e/action" status: 202 len: 0 microversion: 2.1 time: 0.261917 Jun 24 10:04:55.754253 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 273/548] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Jun 24 10:04:55 2022] POST /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:04:55.763260 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-8fec263d-97dc-4e3e-abce-327855e12aa5 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:55.763956 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-8fec263d-97dc-4e3e-abce-327855e12aa5 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:55.770529 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8fec263d-97dc-4e3e-abce-327855e12aa5 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:55.770988 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8fec263d-97dc-4e3e-abce-327855e12aa5 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:55.771747 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8fec263d-97dc-4e3e-abce-327855e12aa5 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:55.772244 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8fec263d-97dc-4e3e-abce-327855e12aa5 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:55.815310 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-7c757429-2f54-4695-8278-bb1e5a89830c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:55.815310 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-7c757429-2f54-4695-8278-bb1e5a89830c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:55.831501 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7c757429-2f54-4695-8278-bb1e5a89830c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:55.831957 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7c757429-2f54-4695-8278-bb1e5a89830c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:55.832762 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7c757429-2f54-4695-8278-bb1e5a89830c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:55.833198 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7c757429-2f54-4695-8278-bb1e5a89830c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:55.925010 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-8fec263d-97dc-4e3e-abce-327855e12aa5 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:55.937462 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-8fec263d-97dc-4e3e-abce-327855e12aa5 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1663 microversion: 2.1 time: 0.178877 Jun 24 10:04:55.938037 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 276/549] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:55 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1663 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:55.983027 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-7c757429-2f54-4695-8278-bb1e5a89830c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:55.991693 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-7c757429-2f54-4695-8278-bb1e5a89830c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:55.993363 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-7c757429-2f54-4695-8278-bb1e5a89830c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:55.994744 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-7c757429-2f54-4695-8278-bb1e5a89830c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1806 microversion: 2.20 time: 0.192658 Jun 24 10:04:55.995306 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 274/550] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:55 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1806 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:56.202739 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-80550ac3-3e3a-484b-be13-38d1f4b0c178 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:56.203345 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-80550ac3-3e3a-484b-be13-38d1f4b0c178 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:56.209457 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-80550ac3-3e3a-484b-be13-38d1f4b0c178 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:56.209906 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-80550ac3-3e3a-484b-be13-38d1f4b0c178 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:56.210667 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-80550ac3-3e3a-484b-be13-38d1f4b0c178 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:56.211095 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-80550ac3-3e3a-484b-be13-38d1f4b0c178 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:56.390514 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-80550ac3-3e3a-484b-be13-38d1f4b0c178 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:56.403935 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-80550ac3-3e3a-484b-be13-38d1f4b0c178 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1734 microversion: 2.1 time: 0.205113 Jun 24 10:04:56.404693 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 277/551] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:56 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1734 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:56.955208 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-382db50c-02ff-428c-a686-f747f90cd5dc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:56.956651 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-382db50c-02ff-428c-a686-f747f90cd5dc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:56.992050 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-382db50c-02ff-428c-a686-f747f90cd5dc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:56.992050 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-382db50c-02ff-428c-a686-f747f90cd5dc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:56.992050 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-382db50c-02ff-428c-a686-f747f90cd5dc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:56.992050 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-382db50c-02ff-428c-a686-f747f90cd5dc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:56.992479 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:04:57.014687 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-759d04a1-a631-4a9a-9c68-6fbcf4da57cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:57.015308 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-759d04a1-a631-4a9a-9c68-6fbcf4da57cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:57.031529 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-759d04a1-a631-4a9a-9c68-6fbcf4da57cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:57.032849 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-759d04a1-a631-4a9a-9c68-6fbcf4da57cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:57.035001 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-759d04a1-a631-4a9a-9c68-6fbcf4da57cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:57.038425 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-759d04a1-a631-4a9a-9c68-6fbcf4da57cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:57.151403 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-382db50c-02ff-428c-a686-f747f90cd5dc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:57.151403 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-382db50c-02ff-428c-a686-f747f90cd5dc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1663 microversion: 2.1 time: 0.199712 Jun 24 10:04:57.154256 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 275/552] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:56 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1663 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:57.156321 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-05c9ca5c-6d24-46c1-a334-ff4d081a87b0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:57.156935 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-05c9ca5c-6d24-46c1-a334-ff4d081a87b0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:57.162840 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-05c9ca5c-6d24-46c1-a334-ff4d081a87b0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:57.163298 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-05c9ca5c-6d24-46c1-a334-ff4d081a87b0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:57.164073 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-05c9ca5c-6d24-46c1-a334-ff4d081a87b0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:57.164709 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-05c9ca5c-6d24-46c1-a334-ff4d081a87b0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:57.204893 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-759d04a1-a631-4a9a-9c68-6fbcf4da57cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:57.215871 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-759d04a1-a631-4a9a-9c68-6fbcf4da57cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:57.217608 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-759d04a1-a631-4a9a-9c68-6fbcf4da57cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:57.219085 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-759d04a1-a631-4a9a-9c68-6fbcf4da57cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1806 microversion: 2.20 time: 0.208208 Jun 24 10:04:57.219814 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 278/553] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:57 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1806 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:04:57.357819 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-05c9ca5c-6d24-46c1-a334-ff4d081a87b0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:57.365931 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-05c9ca5c-6d24-46c1-a334-ff4d081a87b0 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1594 microversion: 2.1 time: 0.213193 Jun 24 10:04:57.366501 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 276/554] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:57 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1594 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:57.421638 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-209f66df-f802-4568-bfe8-ada071e4e7dc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:57.422249 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-209f66df-f802-4568-bfe8-ada071e4e7dc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:57.428407 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-209f66df-f802-4568-bfe8-ada071e4e7dc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:57.428858 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-209f66df-f802-4568-bfe8-ada071e4e7dc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:57.429619 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-209f66df-f802-4568-bfe8-ada071e4e7dc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:57.430058 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-209f66df-f802-4568-bfe8-ada071e4e7dc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:57.599615 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-209f66df-f802-4568-bfe8-ada071e4e7dc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:57.607646 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-209f66df-f802-4568-bfe8-ada071e4e7dc tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1734 microversion: 2.1 time: 0.190107 Jun 24 10:04:57.617964 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 279/555] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:57 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1734 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:58.170121 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-1e47a79e-8874-4910-a02e-d44c90f186e9 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:58.170708 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-1e47a79e-8874-4910-a02e-d44c90f186e9 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:58.177672 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1e47a79e-8874-4910-a02e-d44c90f186e9 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:58.178148 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1e47a79e-8874-4910-a02e-d44c90f186e9 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:58.178987 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1e47a79e-8874-4910-a02e-d44c90f186e9 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:58.179396 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1e47a79e-8874-4910-a02e-d44c90f186e9 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:58.238274 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-689680de-6dc6-4a57-be2f-3b06b361ddb2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:58.242034 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-689680de-6dc6-4a57-be2f-3b06b361ddb2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:58.248939 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-689680de-6dc6-4a57-be2f-3b06b361ddb2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:58.249533 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-689680de-6dc6-4a57-be2f-3b06b361ddb2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:58.250327 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-689680de-6dc6-4a57-be2f-3b06b361ddb2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:58.250768 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-689680de-6dc6-4a57-be2f-3b06b361ddb2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:58.271820 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=100 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:04:58.345338 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-1e47a79e-8874-4910-a02e-d44c90f186e9 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:58.352949 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-1e47a79e-8874-4910-a02e-d44c90f186e9 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1663 microversion: 2.1 time: 0.188149 Jun 24 10:04:58.354062 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 277/556] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:58 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1663 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:58.473517 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-689680de-6dc6-4a57-be2f-3b06b361ddb2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:58.480447 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-689680de-6dc6-4a57-be2f-3b06b361ddb2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:58.482127 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-689680de-6dc6-4a57-be2f-3b06b361ddb2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:58.483321 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-689680de-6dc6-4a57-be2f-3b06b361ddb2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1806 microversion: 2.20 time: 0.249362 Jun 24 10:04:58.483882 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 280/557] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:58 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1806 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:04:58.631452 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-971a4fc7-1e8d-4995-b76f-6d4480d78a0c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:58.632069 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-971a4fc7-1e8d-4995-b76f-6d4480d78a0c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:58.638717 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-971a4fc7-1e8d-4995-b76f-6d4480d78a0c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:58.639174 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-971a4fc7-1e8d-4995-b76f-6d4480d78a0c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:58.639975 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-971a4fc7-1e8d-4995-b76f-6d4480d78a0c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:58.640463 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-971a4fc7-1e8d-4995-b76f-6d4480d78a0c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:58.790571 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-971a4fc7-1e8d-4995-b76f-6d4480d78a0c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:58.798848 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-971a4fc7-1e8d-4995-b76f-6d4480d78a0c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1734 microversion: 2.1 time: 0.177100 Jun 24 10:04:58.799431 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 278/558] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:58 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:59.370578 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-57f784f3-5f9a-45d4-8e6e-97c963162a04 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:59.371372 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-57f784f3-5f9a-45d4-8e6e-97c963162a04 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:59.377985 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-57f784f3-5f9a-45d4-8e6e-97c963162a04 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:59.378516 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-57f784f3-5f9a-45d4-8e6e-97c963162a04 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:59.379821 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-57f784f3-5f9a-45d4-8e6e-97c963162a04 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:59.380362 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-57f784f3-5f9a-45d4-8e6e-97c963162a04 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:59.502940 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-2651e5c2-73c2-4958-ad18-4f93974cdb87 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:59.503837 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-2651e5c2-73c2-4958-ad18-4f93974cdb87 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:59.511241 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2651e5c2-73c2-4958-ad18-4f93974cdb87 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:59.511844 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2651e5c2-73c2-4958-ad18-4f93974cdb87 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:59.512720 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2651e5c2-73c2-4958-ad18-4f93974cdb87 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:59.513228 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2651e5c2-73c2-4958-ad18-4f93974cdb87 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:59.652630 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2651e5c2-73c2-4958-ad18-4f93974cdb87 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:59.662259 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2651e5c2-73c2-4958-ad18-4f93974cdb87 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:59.664031 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2651e5c2-73c2-4958-ad18-4f93974cdb87 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:59.665327 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-2651e5c2-73c2-4958-ad18-4f93974cdb87 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1806 microversion: 2.20 time: 0.167203 Jun 24 10:04:59.666506 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 279/559] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:04:59 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:04:59.817580 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-35435f72-715e-4744-a3c6-dc0ae2ac8ba8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:04:59.818496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-35435f72-715e-4744-a3c6-dc0ae2ac8ba8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:04:59.825988 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-35435f72-715e-4744-a3c6-dc0ae2ac8ba8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:59.826537 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-35435f72-715e-4744-a3c6-dc0ae2ac8ba8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:59.827581 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-35435f72-715e-4744-a3c6-dc0ae2ac8ba8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:04:59.828276 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-35435f72-715e-4744-a3c6-dc0ae2ac8ba8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:04:59.856053 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-57f784f3-5f9a-45d4-8e6e-97c963162a04 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:59.865114 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-57f784f3-5f9a-45d4-8e6e-97c963162a04 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1663 microversion: 2.1 time: 0.499232 Jun 24 10:04:59.875323 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 281/560] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:59 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1663 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:04:59.976049 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-35435f72-715e-4744-a3c6-dc0ae2ac8ba8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:04:59.988095 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-35435f72-715e-4744-a3c6-dc0ae2ac8ba8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1714 microversion: 2.1 time: 0.175669 Jun 24 10:04:59.988946 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 280/561] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:04:59 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1714 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:05:00.099428 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-0b9f967f-798d-4877-b471-3c37f2d5450f tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:00.099972 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-0b9f967f-798d-4877-b471-3c37f2d5450f tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:00.106865 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0b9f967f-798d-4877-b471-3c37f2d5450f tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:00.116495 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0b9f967f-798d-4877-b471-3c37f2d5450f tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:00.116495 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0b9f967f-798d-4877-b471-3c37f2d5450f tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:00.116495 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0b9f967f-798d-4877-b471-3c37f2d5450f tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:00.237592 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-5d858d86-e978-49ba-a7d4-8c86554e4419 req-4038ef3d-0854-4a24-a6b0-3b030d5b71dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af9804ec-09cf-4bd7-bf69-83dc28a5d1d5", "tag": "9232a5f7-d95a-44a5-b49d-7664a4d75f80"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:05:00.250540 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-5d858d86-e978-49ba-a7d4-8c86554e4419 req-4038ef3d-0854-4a24-a6b0-3b030d5b71dd service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:00.250841 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-5d858d86-e978-49ba-a7d4-8c86554e4419 req-4038ef3d-0854-4a24-a6b0-3b030d5b71dd service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:00.252930 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-0b9f967f-798d-4877-b471-3c37f2d5450f tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] HTTP exception thrown: Cannot 'detach_volume' instance c170d532-d8da-4b26-879d-22c7dc180716 while it is in vm_state rescued Jun 24 10:05:00.254746 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-0b9f967f-798d-4877-b471-3c37f2d5450f tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Request method failure captured: Jun 24 10:05:00.254746 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: DELETE /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716/os-volume_attachments/2828bffb-c5ff-4336-bda3-a98f1e2b3f67 HTTP/1.1 Jun 24 10:05:00.254746 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:05:00.254746 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:05:00.254746 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:05:00.254746 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 0 Jun 24 10:05:00.254746 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:05:00.254746 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:05:00.254746 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:05:00.254746 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:05:00.254746 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitYtobSN6CjiACUjTyXEql4xKzLsglXk-l3YaDQLAZo4vs-RgMAM3IADpJhPypTRBSlCExLMR--YbzFicmjbwkbj-OJB_zzYsnZ_Gbqq5n_CnUB_ypRKgSN3BcXHuMsmCBlnf0I3kK4SJFeqnT6AupdpkZsj57O8A_owmEagvxq33osI Jun 24 10:05:00.254746 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:05:00.254746 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:05:00.254746 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:05:00.254746 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:05:00.254746 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:05:00.254746 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:05:00.254746 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: ddf89eff2d584c508a967f1686090be1 Jun 24 10:05:00.254746 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1125620466 Jun 24 10:05:00.254746 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:05:00.254746 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:05:00.256299 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ddf89eff2d584c508a967f1686090be1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ddf89eff2d584c508a967f1686090be1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ddf89eff2d584c508a967f1686090be1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ddf89eff2d584c508a967f1686090be1"}]}] Jun 24 10:05:00.256299 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1125620466 Jun 24 10:05:00.256299 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: ddf89eff2d584c508a967f1686090be1 Jun 24 10:05:00.256299 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1125620466 Jun 24 10:05:00.256299 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-ServerRescueNegativeTestJSON-1125620466-project Jun 24 10:05:00.256299 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:05:00.256299 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:05:00.256299 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: b03913e742104648977aa5d61347f38e Jun 24 10:05:00.256299 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1125620466-project Jun 24 10:05:00.256299 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: > Jun 24 10:05:00.256299 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Cannot 'detach_volume' instance c170d532-d8da-4b26-879d-22c7dc180716 while it is in vm_state rescued Jun 24 10:05:00.257030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'server_id': 'c170d532-d8da-4b26-879d-22c7dc180716', 'id': '2828bffb-c5ff-4336-bda3-a98f1e2b3f67'} Jun 24 10:05:00.257030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:05:00.257030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:05:00.257030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 24 10:05:00.257030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 24 10:05:00.257030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 10:05:00.257030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 10:05:00.257030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 24 10:05:00.257030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 24 10:05:00.257030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c170d532-d8da-4b26-879d-22c7dc180716 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 24 10:05:00.257030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:05:00.257030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:05:00.257030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:05:00.257030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:05:00.257030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:05:00.257030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:05:00.257030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:05:00.257030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:05:00.257030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:05:00.257030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:05:00.258300 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 24 10:05:00.258300 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 24 10:05:00.258300 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 24 10:05:00.258300 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 24 10:05:00.258300 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c170d532-d8da-4b26-879d-22c7dc180716 while it is in vm_state rescued Jun 24 10:05:00.258300 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:05:00.258300 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:05:00.258300 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:05:00.258300 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:05:00.258300 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:05:00.258300 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:05:00.258300 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:05:00.258300 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:05:00.258300 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c170d532-d8da-4b26-879d-22c7dc180716 while it is in vm_state rescued Jun 24 10:05:00.258300 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:05:00.270839 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-0b9f967f-798d-4877-b471-3c37f2d5450f tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Returning 409 to user: Cannot 'detach_volume' instance c170d532-d8da-4b26-879d-22c7dc180716 while it is in vm_state rescued {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:05:00.271998 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-0b9f967f-798d-4877-b471-3c37f2d5450f tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716/os-volume_attachments/2828bffb-c5ff-4336-bda3-a98f1e2b3f67" status: 409 len: 152 microversion: 2.1 time: 0.176826 Jun 24 10:05:00.272756 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 282/562] 10.222.0.26 () {58 vars in 1415 bytes} [Fri Jun 24 10:05:00 2022] DELETE /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716/os-volume_attachments/2828bffb-c5ff-4336-bda3-a98f1e2b3f67 => generated 152 bytes in 178 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 24 10:05:00.282829 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-5d858d86-e978-49ba-a7d4-8c86554e4419 req-4038ef3d-0854-4a24-a6b0-3b030d5b71dd service nova] Creating event network-changed:9232a5f7-d95a-44a5-b49d-7664a4d75f80 for instance af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 on hv-cinder-84327 Jun 24 10:05:00.282964 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-da125f67-db7d-4f37-9370-49929edfc096 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:05:00.282964 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-da125f67-db7d-4f37-9370-49929edfc096 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:00.285463 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-5d858d86-e978-49ba-a7d4-8c86554e4419 req-4038ef3d-0854-4a24-a6b0-3b030d5b71dd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056003 Jun 24 10:05:00.286105 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 281/563] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:05:00.290889 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-da125f67-db7d-4f37-9370-49929edfc096 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:00.291411 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-da125f67-db7d-4f37-9370-49929edfc096 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:00.292291 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-da125f67-db7d-4f37-9370-49929edfc096 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:00.292812 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-da125f67-db7d-4f37-9370-49929edfc096 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:00.517713 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-da125f67-db7d-4f37-9370-49929edfc096 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "POST /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716/action" status: 202 len: 0 microversion: 2.1 time: 0.239566 Jun 24 10:05:00.518603 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 283/564] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Jun 24 10:05:00 2022] POST /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 10:05:00.528707 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-44b0b05a-54ac-4f1d-ae29-bdfb4c30ac58 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:00.530142 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-44b0b05a-54ac-4f1d-ae29-bdfb4c30ac58 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:00.537920 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-44b0b05a-54ac-4f1d-ae29-bdfb4c30ac58 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:00.538746 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-44b0b05a-54ac-4f1d-ae29-bdfb4c30ac58 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:00.539818 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-44b0b05a-54ac-4f1d-ae29-bdfb4c30ac58 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:00.540488 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-44b0b05a-54ac-4f1d-ae29-bdfb4c30ac58 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:00.690883 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-1382f5c4-4f5b-4805-856e-b8e467b66c42 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:00.692503 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-1382f5c4-4f5b-4805-856e-b8e467b66c42 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:00.704877 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1382f5c4-4f5b-4805-856e-b8e467b66c42 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:00.705674 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1382f5c4-4f5b-4805-856e-b8e467b66c42 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:00.706704 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1382f5c4-4f5b-4805-856e-b8e467b66c42 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:00.707433 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1382f5c4-4f5b-4805-856e-b8e467b66c42 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:00.807726 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-44b0b05a-54ac-4f1d-ae29-bdfb4c30ac58 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:00.819042 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-44b0b05a-54ac-4f1d-ae29-bdfb4c30ac58 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1722 microversion: 2.1 time: 0.295833 Jun 24 10:05:00.822929 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 282/565] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:00 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1722 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:05:00.893536 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-6a0f988b-a4e5-49db-be22-81b16bca2fbd tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:00.894948 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-6a0f988b-a4e5-49db-be22-81b16bca2fbd tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:00.903018 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6a0f988b-a4e5-49db-be22-81b16bca2fbd tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:00.903733 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6a0f988b-a4e5-49db-be22-81b16bca2fbd tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:00.904858 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6a0f988b-a4e5-49db-be22-81b16bca2fbd tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:00.906333 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6a0f988b-a4e5-49db-be22-81b16bca2fbd tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:00.981848 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-1382f5c4-4f5b-4805-856e-b8e467b66c42 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:00.991032 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-1382f5c4-4f5b-4805-856e-b8e467b66c42 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:00.993077 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-1382f5c4-4f5b-4805-856e-b8e467b66c42 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:00.995221 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-1382f5c4-4f5b-4805-856e-b8e467b66c42 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1793 microversion: 2.20 time: 0.313627 Jun 24 10:05:01.015221 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 284/566] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:05:00 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1793 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:05:01.298815 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-6a0f988b-a4e5-49db-be22-81b16bca2fbd tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:01.309068 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-6a0f988b-a4e5-49db-be22-81b16bca2fbd tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1667 microversion: 2.1 time: 0.426319 Jun 24 10:05:01.310152 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 283/567] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:00 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1667 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:05:01.840873 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-2192d8be-2ee1-4efd-a04b-ef26d8aa1ccd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:01.841809 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-2192d8be-2ee1-4efd-a04b-ef26d8aa1ccd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:01.849168 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2192d8be-2ee1-4efd-a04b-ef26d8aa1ccd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:01.849876 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2192d8be-2ee1-4efd-a04b-ef26d8aa1ccd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:01.851479 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2192d8be-2ee1-4efd-a04b-ef26d8aa1ccd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:01.851976 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2192d8be-2ee1-4efd-a04b-ef26d8aa1ccd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:02.009434 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-2192d8be-2ee1-4efd-a04b-ef26d8aa1ccd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:02.018209 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-2192d8be-2ee1-4efd-a04b-ef26d8aa1ccd tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1722 microversion: 2.1 time: 0.181539 Jun 24 10:05:02.018784 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 285/568] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:01 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:05:03.035340 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-0cff9066-28ef-4c75-a1b9-e1a860870ddb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:03.035957 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-0cff9066-28ef-4c75-a1b9-e1a860870ddb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:03.042863 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0cff9066-28ef-4c75-a1b9-e1a860870ddb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:03.043345 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0cff9066-28ef-4c75-a1b9-e1a860870ddb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:03.044477 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0cff9066-28ef-4c75-a1b9-e1a860870ddb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:03.044949 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0cff9066-28ef-4c75-a1b9-e1a860870ddb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:03.064388 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-bf16c5d7-212c-49cb-8f91-af8a43970ed8 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-425148660"}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:05:03.065031 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-bf16c5d7-212c-49cb-8f91-af8a43970ed8 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:03.070984 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-bf16c5d7-212c-49cb-8f91-af8a43970ed8 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:03.071580 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-bf16c5d7-212c-49cb-8f91-af8a43970ed8 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:03.072376 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-bf16c5d7-212c-49cb-8f91-af8a43970ed8 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:03.072814 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-bf16c5d7-212c-49cb-8f91-af8a43970ed8 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:03.187121 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-0cff9066-28ef-4c75-a1b9-e1a860870ddb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:03.195151 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-0cff9066-28ef-4c75-a1b9-e1a860870ddb tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1722 microversion: 2.1 time: 0.163978 Jun 24 10:05:03.195727 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 284/569] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:03 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:05:03.208738 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.network.security_group_api [None req-bf16c5d7-212c-49cb-8f91-af8a43970ed8 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Adding security group 69854125-db12-434f-b67e-c4a42098b62d to port 9232a5f7-d95a-44a5-b49d-7664a4d75f80 Jun 24 10:05:03.646892 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-bf16c5d7-212c-49cb-8f91-af8a43970ed8 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "POST /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5/action" status: 202 len: 0 microversion: 2.1 time: 0.585178 Jun 24 10:05:03.646892 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 286/570] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Jun 24 10:05:03 2022] POST /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5/action => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 10:05:03.656420 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-e9cc2b30-96a9-4ce8-98b7-92fbe88c5107 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:03.659554 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-e9cc2b30-96a9-4ce8-98b7-92fbe88c5107 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:03.671016 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-aeec1b26-b012-4c00-a10f-b26913ea9676 req-7fb568d5-00a9-424c-a551-f8d9aa20039c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af9804ec-09cf-4bd7-bf69-83dc28a5d1d5", "tag": "9232a5f7-d95a-44a5-b49d-7664a4d75f80"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:05:03.680401 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e9cc2b30-96a9-4ce8-98b7-92fbe88c5107 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:03.682295 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e9cc2b30-96a9-4ce8-98b7-92fbe88c5107 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:03.683856 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e9cc2b30-96a9-4ce8-98b7-92fbe88c5107 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:03.686592 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-aeec1b26-b012-4c00-a10f-b26913ea9676 req-7fb568d5-00a9-424c-a551-f8d9aa20039c service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:03.687734 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-aeec1b26-b012-4c00-a10f-b26913ea9676 req-7fb568d5-00a9-424c-a551-f8d9aa20039c service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:03.687853 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e9cc2b30-96a9-4ce8-98b7-92fbe88c5107 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:03.703822 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-aeec1b26-b012-4c00-a10f-b26913ea9676 req-7fb568d5-00a9-424c-a551-f8d9aa20039c service nova] Creating event network-changed:9232a5f7-d95a-44a5-b49d-7664a4d75f80 for instance af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 on hv-cinder-84327 Jun 24 10:05:03.711690 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-aeec1b26-b012-4c00-a10f-b26913ea9676 req-7fb568d5-00a9-424c-a551-f8d9aa20039c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053466 Jun 24 10:05:03.713263 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 287/571] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:05:03.850250 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-e9cc2b30-96a9-4ce8-98b7-92fbe88c5107 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:03.859101 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-e9cc2b30-96a9-4ce8-98b7-92fbe88c5107 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1759 microversion: 2.1 time: 0.209487 Jun 24 10:05:03.868654 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 285/572] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:03 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1759 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:05:04.212988 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-ef0f2e4e-2e6d-48d9-ad80-dca69c35421a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:04.214325 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-ef0f2e4e-2e6d-48d9-ad80-dca69c35421a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:04.221119 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ef0f2e4e-2e6d-48d9-ad80-dca69c35421a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:04.221577 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ef0f2e4e-2e6d-48d9-ad80-dca69c35421a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:04.222352 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ef0f2e4e-2e6d-48d9-ad80-dca69c35421a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:04.222799 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ef0f2e4e-2e6d-48d9-ad80-dca69c35421a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:04.359527 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-ef0f2e4e-2e6d-48d9-ad80-dca69c35421a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:04.368464 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-ef0f2e4e-2e6d-48d9-ad80-dca69c35421a tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1722 microversion: 2.1 time: 0.160104 Jun 24 10:05:04.372576 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 288/573] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:04 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:05:05.386723 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-7de7e618-cc91-4f3c-a556-6cecdd0c14a0 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:05.388048 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-7de7e618-cc91-4f3c-a556-6cecdd0c14a0 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:05.395949 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7de7e618-cc91-4f3c-a556-6cecdd0c14a0 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:05.396431 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7de7e618-cc91-4f3c-a556-6cecdd0c14a0 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:05.397211 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7de7e618-cc91-4f3c-a556-6cecdd0c14a0 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:05.397652 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7de7e618-cc91-4f3c-a556-6cecdd0c14a0 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:05.606651 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-7de7e618-cc91-4f3c-a556-6cecdd0c14a0 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:05.615604 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-7de7e618-cc91-4f3c-a556-6cecdd0c14a0 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1728 microversion: 2.1 time: 0.233030 Jun 24 10:05:05.616286 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 286/574] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:05 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1728 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:05:05.632071 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-6b3a7693-4fc6-4a9a-8410-3bf566544067 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:05.632601 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-6b3a7693-4fc6-4a9a-8410-3bf566544067 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:05.640097 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6b3a7693-4fc6-4a9a-8410-3bf566544067 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:05.640097 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6b3a7693-4fc6-4a9a-8410-3bf566544067 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:05.640807 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6b3a7693-4fc6-4a9a-8410-3bf566544067 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:05.641251 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6b3a7693-4fc6-4a9a-8410-3bf566544067 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:05.720943 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-6b3a7693-4fc6-4a9a-8410-3bf566544067 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092825 Jun 24 10:05:05.721536 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 289/575] 10.222.0.26 () {58 vars in 1274 bytes} [Fri Jun 24 10:05:05 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:05:07.068034 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-7b6265ab-0d7a-46f2-862f-3fe977e7523f req-f5453669-4f32-4a67-8895-88a8c2cab7f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c170d532-d8da-4b26-879d-22c7dc180716", "tag": "62ac8ae2-de6d-4539-8e21-9a572eab33d9"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:05:07.076700 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-7b6265ab-0d7a-46f2-862f-3fe977e7523f req-f5453669-4f32-4a67-8895-88a8c2cab7f8 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:07.077212 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-7b6265ab-0d7a-46f2-862f-3fe977e7523f req-f5453669-4f32-4a67-8895-88a8c2cab7f8 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:07.090069 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-7b6265ab-0d7a-46f2-862f-3fe977e7523f req-f5453669-4f32-4a67-8895-88a8c2cab7f8 service nova] Creating event network-changed:62ac8ae2-de6d-4539-8e21-9a572eab33d9 for instance c170d532-d8da-4b26-879d-22c7dc180716 on hv-cinder-84327 Jun 24 10:05:07.095851 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-7b6265ab-0d7a-46f2-862f-3fe977e7523f req-f5453669-4f32-4a67-8895-88a8c2cab7f8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031466 Jun 24 10:05:07.096498 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 287/576] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:05:09.110788 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-c1a4f340-4c9f-40a1-a1bf-17d08950f6b0 req-80df6906-f6dc-4949-8844-cdc1e212c3ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c170d532-d8da-4b26-879d-22c7dc180716", "tag": "62ac8ae2-de6d-4539-8e21-9a572eab33d9"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:05:09.118797 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-c1a4f340-4c9f-40a1-a1bf-17d08950f6b0 req-80df6906-f6dc-4949-8844-cdc1e212c3ff service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:09.119238 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-c1a4f340-4c9f-40a1-a1bf-17d08950f6b0 req-80df6906-f6dc-4949-8844-cdc1e212c3ff service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:09.130200 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-c1a4f340-4c9f-40a1-a1bf-17d08950f6b0 req-80df6906-f6dc-4949-8844-cdc1e212c3ff service nova] Creating event network-changed:62ac8ae2-de6d-4539-8e21-9a572eab33d9 for instance c170d532-d8da-4b26-879d-22c7dc180716 on hv-cinder-84327 Jun 24 10:05:09.135090 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-c1a4f340-4c9f-40a1-a1bf-17d08950f6b0 req-80df6906-f6dc-4949-8844-cdc1e212c3ff service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029267 Jun 24 10:05:09.135694 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 290/577] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:05:12.031802 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-a04c786f-2a24-4c79-928f-b936c54899c1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b0dcb65-a523-417f-8603-ca264d0bc8d3", "device": "/dev/sdb"}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:05:12.033518 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-a04c786f-2a24-4c79-928f-b936c54899c1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: d3972b3f-604a-486b-abef-10ecb7b76c4d] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:12.039704 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a04c786f-2a24-4c79-928f-b936c54899c1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:12.040201 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a04c786f-2a24-4c79-928f-b936c54899c1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:12.040994 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a04c786f-2a24-4c79-928f-b936c54899c1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:12.041431 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a04c786f-2a24-4c79-928f-b936c54899c1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:12.843377 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-a04c786f-2a24-4c79-928f-b936c54899c1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "POST /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.816485 Jun 24 10:05:12.843996 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 288/578] 10.222.0.26 () {60 vars in 1322 bytes} [Fri Jun 24 10:05:12 2022] POST /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d/os-volume_attachments => generated 194 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:05:37.464107 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_api:SELECT=83 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:05:37.464916 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:05:37.469868 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-65b00f1b-faf4-4014-8bde-e862f9232222 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:37.474692 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-65b00f1b-faf4-4014-8bde-e862f9232222 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: d3972b3f-604a-486b-abef-10ecb7b76c4d] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:37.476958 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-65b00f1b-faf4-4014-8bde-e862f9232222 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:37.477405 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-65b00f1b-faf4-4014-8bde-e862f9232222 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:37.478176 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-65b00f1b-faf4-4014-8bde-e862f9232222 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:37.478606 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-65b00f1b-faf4-4014-8bde-e862f9232222 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:37.562975 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.objects.instance [None req-65b00f1b-faf4-4014-8bde-e862f9232222 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lazy-loading 'services' on Instance uuid d3972b3f-604a-486b-abef-10ecb7b76c4d {{(pid=124979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:05:37.841002 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-65b00f1b-faf4-4014-8bde-e862f9232222 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d/os-volume_attachments/0b0dcb65-a523-417f-8603-ca264d0bc8d3" status: 202 len: 0 microversion: 2.1 time: 0.378377 Jun 24 10:05:37.841605 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 291/579] 10.222.0.26 () {58 vars in 1415 bytes} [Fri Jun 24 10:05:37 2022] DELETE /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d/os-volume_attachments/0b0dcb65-a523-417f-8603-ca264d0bc8d3 => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:05:40.007996 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_api:SELECT=89 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:05:40.008861 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:05:40.012884 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-6c2e5ead-62d9-4032-90a6-a0c19df3fe52 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:40.013466 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-6c2e5ead-62d9-4032-90a6-a0c19df3fe52 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: d3972b3f-604a-486b-abef-10ecb7b76c4d] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:40.019689 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6c2e5ead-62d9-4032-90a6-a0c19df3fe52 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:40.030156 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6c2e5ead-62d9-4032-90a6-a0c19df3fe52 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:40.030156 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6c2e5ead-62d9-4032-90a6-a0c19df3fe52 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:40.030156 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6c2e5ead-62d9-4032-90a6-a0c19df3fe52 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:40.046004 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-6c2e5ead-62d9-4032-90a6-a0c19df3fe52 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: d3972b3f-604a-486b-abef-10ecb7b76c4d] Going to try to terminate instance {{(pid=124980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:05:40.333498 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-6c2e5ead-62d9-4032-90a6-a0c19df3fe52 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d" status: 204 len: 0 microversion: 2.1 time: 0.326788 Jun 24 10:05:40.334103 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 289/580] 10.222.0.26 () {58 vars in 1238 bytes} [Fri Jun 24 10:05:40 2022] DELETE /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:05:40.343335 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-88896063-6fab-4186-8f30-7320dfa00dc4 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:40.344039 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-88896063-6fab-4186-8f30-7320dfa00dc4 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: d3972b3f-604a-486b-abef-10ecb7b76c4d] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:40.350889 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-88896063-6fab-4186-8f30-7320dfa00dc4 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:40.351358 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-88896063-6fab-4186-8f30-7320dfa00dc4 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:40.352098 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-88896063-6fab-4186-8f30-7320dfa00dc4 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:40.352555 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-88896063-6fab-4186-8f30-7320dfa00dc4 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:40.496385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-88896063-6fab-4186-8f30-7320dfa00dc4 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:40.503821 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-88896063-6fab-4186-8f30-7320dfa00dc4 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d" status: 200 len: 1514 microversion: 2.1 time: 0.165304 Jun 24 10:05:40.504410 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 292/581] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:40 2022] GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:05:41.522537 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-1fe1673d-8588-4bd7-af45-84f8a2be6393 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:41.523308 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-1fe1673d-8588-4bd7-af45-84f8a2be6393 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: d3972b3f-604a-486b-abef-10ecb7b76c4d] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:41.530212 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1fe1673d-8588-4bd7-af45-84f8a2be6393 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:41.530663 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1fe1673d-8588-4bd7-af45-84f8a2be6393 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:41.531442 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1fe1673d-8588-4bd7-af45-84f8a2be6393 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:41.531919 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1fe1673d-8588-4bd7-af45-84f8a2be6393 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:41.674971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-1fe1673d-8588-4bd7-af45-84f8a2be6393 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:41.686263 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-1fe1673d-8588-4bd7-af45-84f8a2be6393 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d" status: 200 len: 1514 microversion: 2.1 time: 0.168219 Jun 24 10:05:41.686837 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 290/582] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:41 2022] GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:05:42.703724 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-b85c9be2-f121-434c-833a-0086c08ee349 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:42.704904 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-b85c9be2-f121-434c-833a-0086c08ee349 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: d3972b3f-604a-486b-abef-10ecb7b76c4d] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:42.710999 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b85c9be2-f121-434c-833a-0086c08ee349 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:42.711454 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b85c9be2-f121-434c-833a-0086c08ee349 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:42.712257 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b85c9be2-f121-434c-833a-0086c08ee349 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:42.712698 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b85c9be2-f121-434c-833a-0086c08ee349 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:42.872179 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-b85c9be2-f121-434c-833a-0086c08ee349 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:42.889016 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-ad8d5d39-d76f-4dd7-a81e-c32afbf15456 req-fd5c4f04-e0e1-4156-adff-fe07414906c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3972b3f-604a-486b-abef-10ecb7b76c4d", "name": "network-vif-deleted", "tag": "e4868241-59b8-4c94-9a71-0b90b713aec0"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:05:42.890770 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-b85c9be2-f121-434c-833a-0086c08ee349 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d" status: 200 len: 1514 microversion: 2.1 time: 0.191571 Jun 24 10:05:42.891509 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 293/583] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:42 2022] GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d => generated 1514 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:05:42.894432 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-ad8d5d39-d76f-4dd7-a81e-c32afbf15456 req-fd5c4f04-e0e1-4156-adff-fe07414906c5 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:42.895064 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-ad8d5d39-d76f-4dd7-a81e-c32afbf15456 req-fd5c4f04-e0e1-4156-adff-fe07414906c5 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:42.906271 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-ad8d5d39-d76f-4dd7-a81e-c32afbf15456 req-fd5c4f04-e0e1-4156-adff-fe07414906c5 service nova] Creating event network-vif-deleted:e4868241-59b8-4c94-9a71-0b90b713aec0 for instance d3972b3f-604a-486b-abef-10ecb7b76c4d on hv-cinder-84327 Jun 24 10:05:42.911450 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-ad8d5d39-d76f-4dd7-a81e-c32afbf15456 req-fd5c4f04-e0e1-4156-adff-fe07414906c5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029805 Jun 24 10:05:42.912188 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 291/584] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:05:43.579573 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-da7bea3a-15cf-4c2b-8cc2-e88b35a799ce tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:05:43.580733 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-da7bea3a-15cf-4c2b-8cc2-e88b35a799ce tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:43.589108 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-da7bea3a-15cf-4c2b-8cc2-e88b35a799ce tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:43.589563 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-da7bea3a-15cf-4c2b-8cc2-e88b35a799ce tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:43.590341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-da7bea3a-15cf-4c2b-8cc2-e88b35a799ce tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:43.590780 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-da7bea3a-15cf-4c2b-8cc2-e88b35a799ce tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:43.868645 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-da7bea3a-15cf-4c2b-8cc2-e88b35a799ce tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "POST /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5/action" status: 202 len: 0 microversion: 2.1 time: 0.293106 Jun 24 10:05:43.869521 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 294/585] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Jun 24 10:05:43 2022] POST /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:05:43.878073 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-8814c63c-ba0f-4ed9-956b-0745a820aef4 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:43.878786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-8814c63c-ba0f-4ed9-956b-0745a820aef4 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:43.885239 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8814c63c-ba0f-4ed9-956b-0745a820aef4 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:43.885769 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8814c63c-ba0f-4ed9-956b-0745a820aef4 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:43.886549 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8814c63c-ba0f-4ed9-956b-0745a820aef4 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:43.887132 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8814c63c-ba0f-4ed9-956b-0745a820aef4 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:43.909241 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-153be9ae-0a8b-4610-9503-30d538052149 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:43.909940 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-153be9ae-0a8b-4610-9503-30d538052149 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: d3972b3f-604a-486b-abef-10ecb7b76c4d] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:43.916375 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-153be9ae-0a8b-4610-9503-30d538052149 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:43.916831 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-153be9ae-0a8b-4610-9503-30d538052149 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:43.917597 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-153be9ae-0a8b-4610-9503-30d538052149 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:43.918209 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-153be9ae-0a8b-4610-9503-30d538052149 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:43.954561 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-153be9ae-0a8b-4610-9503-30d538052149 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:43.954937 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-153be9ae-0a8b-4610-9503-30d538052149 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:43.955397 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.objects.instance [None req-153be9ae-0a8b-4610-9503-30d538052149 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lazy-loading 'fault' on Instance uuid d3972b3f-604a-486b-abef-10ecb7b76c4d {{(pid=124979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:05:44.005484 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-153be9ae-0a8b-4610-9503-30d538052149 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:44.012636 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-153be9ae-0a8b-4610-9503-30d538052149 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d" status: 200 len: 1308 microversion: 2.1 time: 0.108002 Jun 24 10:05:44.013215 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 295/586] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:43 2022] GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:05:44.102132 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-8814c63c-ba0f-4ed9-956b-0745a820aef4 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:44.110420 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-8814c63c-ba0f-4ed9-956b-0745a820aef4 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1751 microversion: 2.1 time: 0.236570 Jun 24 10:05:44.110984 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 292/587] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:43 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1751 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:05:45.031170 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-8ac53a01-a692-42f8-9fe1-8b06df525cda tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:45.032229 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-8ac53a01-a692-42f8-9fe1-8b06df525cda tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: d3972b3f-604a-486b-abef-10ecb7b76c4d] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:45.039053 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8ac53a01-a692-42f8-9fe1-8b06df525cda tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:45.039497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8ac53a01-a692-42f8-9fe1-8b06df525cda tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:45.040303 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8ac53a01-a692-42f8-9fe1-8b06df525cda tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:45.040740 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8ac53a01-a692-42f8-9fe1-8b06df525cda tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:45.055144 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-8ac53a01-a692-42f8-9fe1-8b06df525cda tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] HTTP exception thrown: Instance d3972b3f-604a-486b-abef-10ecb7b76c4d could not be found. Jun 24 10:05:45.056945 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-8ac53a01-a692-42f8-9fe1-8b06df525cda tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Request method failure captured: Jun 24 10:05:45.056945 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d HTTP/1.1 Jun 24 10:05:45.056945 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:05:45.056945 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:05:45.056945 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:05:45.056945 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 0 Jun 24 10:05:45.056945 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:05:45.056945 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:05:45.056945 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:05:45.056945 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:05:45.056945 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitYwtHNgAIVY8GKei0PMLVA5Y3V2_y7vftVPt-kYSI9C6AkvJ1cYg7owg3a8JFbAiukD3Q6iTFxuZfJdtFh1lyYWE3rsEvmoMTF5HU9UXx81NTW7bCWEP9rl8KLn_9R3_Upi2a-a8jEvR0Fvu-qmqUgiyXR0YVyCJJ20pvYHi4UZkP-U Jun 24 10:05:45.056945 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:05:45.056945 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:05:45.056945 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:05:45.056945 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:05:45.056945 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:05:45.056945 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:05:45.056945 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: 28def10792f645c491f98a134ff71dce Jun 24 10:05:45.056945 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1274240851 Jun 24 10:05:45.056945 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:05:45.056945 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:05:45.058508 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/28def10792f645c491f98a134ff71dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_28def10792f645c491f98a134ff71dce", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/28def10792f645c491f98a134ff71dce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/28def10792f645c491f98a134ff71dce"}]}] Jun 24 10:05:45.058508 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-VolumesSnapshotTestJSON-1274240851 Jun 24 10:05:45.058508 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: 28def10792f645c491f98a134ff71dce Jun 24 10:05:45.058508 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1274240851 Jun 24 10:05:45.058508 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-VolumesSnapshotTestJSON-1274240851-project Jun 24 10:05:45.058508 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:05:45.058508 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:05:45.058508 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: cec38b1840f448e5a585469900801917 Jun 24 10:05:45.058508 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-VolumesSnapshotTestJSON-1274240851-project Jun 24 10:05:45.058508 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: > Jun 24 10:05:45.058508 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Instance d3972b3f-604a-486b-abef-10ecb7b76c4d could not be found. Jun 24 10:05:45.058508 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'id': 'd3972b3f-604a-486b-abef-10ecb7b76c4d'} Jun 24 10:05:45.059414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:05:45.059414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:05:45.059414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:05:45.059414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:05:45.059414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:05:45.059414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:05:45.059414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:05:45.059414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:05:45.059414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:05:45.059414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:05:45.059414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3972b3f-604a-486b-abef-10ecb7b76c4d could not be found. Jun 24 10:05:45.059414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:05:45.059414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:05:45.059414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:05:45.059414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:05:45.059414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:05:45.059414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:05:45.059414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:05:45.059414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:05:45.059414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:05:45.060914 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:05:45.060914 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:05:45.060914 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:05:45.060914 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:05:45.060914 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:05:45.060914 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:05:45.060914 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:05:45.060914 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3972b3f-604a-486b-abef-10ecb7b76c4d could not be found. Jun 24 10:05:45.060914 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:05:45.060914 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:05:45.060914 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:05:45.060914 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:05:45.060914 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:05:45.060914 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:05:45.060914 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:05:45.060914 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:05:45.060914 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3972b3f-604a-486b-abef-10ecb7b76c4d could not be found. Jun 24 10:05:45.060914 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:05:45.062272 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-8ac53a01-a692-42f8-9fe1-8b06df525cda tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Returning 404 to user: Instance d3972b3f-604a-486b-abef-10ecb7b76c4d could not be found. {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:05:45.062272 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-8ac53a01-a692-42f8-9fe1-8b06df525cda tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d" status: 404 len: 111 microversion: 2.1 time: 0.031244 Jun 24 10:05:45.062272 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 296/588] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:45 2022] GET /compute/v2.1/servers/d3972b3f-604a-486b-abef-10ecb7b76c4d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:05:45.127104 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-a4e9584d-8b04-482e-bccf-5addcc7b83aa tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:45.127891 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-a4e9584d-8b04-482e-bccf-5addcc7b83aa tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:45.134838 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a4e9584d-8b04-482e-bccf-5addcc7b83aa tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:45.135294 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a4e9584d-8b04-482e-bccf-5addcc7b83aa tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:45.136189 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a4e9584d-8b04-482e-bccf-5addcc7b83aa tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:45.136560 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a4e9584d-8b04-482e-bccf-5addcc7b83aa tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:45.299501 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-a4e9584d-8b04-482e-bccf-5addcc7b83aa tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:45.307717 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-a4e9584d-8b04-482e-bccf-5addcc7b83aa tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1756 microversion: 2.1 time: 0.184439 Jun 24 10:05:45.310588 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 293/589] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:45 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:05:46.325431 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-0ece2fe3-6b22-4a48-80ce-fbfccaa5e6e6 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:46.326080 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-0ece2fe3-6b22-4a48-80ce-fbfccaa5e6e6 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:46.332717 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0ece2fe3-6b22-4a48-80ce-fbfccaa5e6e6 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:46.333178 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0ece2fe3-6b22-4a48-80ce-fbfccaa5e6e6 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:46.333943 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0ece2fe3-6b22-4a48-80ce-fbfccaa5e6e6 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:46.334383 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0ece2fe3-6b22-4a48-80ce-fbfccaa5e6e6 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:46.481959 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-0ece2fe3-6b22-4a48-80ce-fbfccaa5e6e6 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:46.490710 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-0ece2fe3-6b22-4a48-80ce-fbfccaa5e6e6 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1756 microversion: 2.1 time: 0.169204 Jun 24 10:05:46.491269 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 297/590] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:46 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:05:47.508221 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-5a74f6de-8e59-4483-973f-1c27a36de826 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:47.508870 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-5a74f6de-8e59-4483-973f-1c27a36de826 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:47.515028 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5a74f6de-8e59-4483-973f-1c27a36de826 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:47.515484 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5a74f6de-8e59-4483-973f-1c27a36de826 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:47.516301 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5a74f6de-8e59-4483-973f-1c27a36de826 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:47.516762 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5a74f6de-8e59-4483-973f-1c27a36de826 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:47.676701 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-5a74f6de-8e59-4483-973f-1c27a36de826 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:47.685068 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-5a74f6de-8e59-4483-973f-1c27a36de826 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1756 microversion: 2.1 time: 0.180941 Jun 24 10:05:47.685649 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 294/591] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:47 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:05:48.704626 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-104fa50a-2fe0-422e-9792-eb096b619de5 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:48.705276 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-104fa50a-2fe0-422e-9792-eb096b619de5 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:48.712158 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-104fa50a-2fe0-422e-9792-eb096b619de5 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:48.712620 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-104fa50a-2fe0-422e-9792-eb096b619de5 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:48.713464 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-104fa50a-2fe0-422e-9792-eb096b619de5 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:48.713836 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-104fa50a-2fe0-422e-9792-eb096b619de5 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:48.872281 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-104fa50a-2fe0-422e-9792-eb096b619de5 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:48.881322 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-104fa50a-2fe0-422e-9792-eb096b619de5 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1756 microversion: 2.1 time: 0.182046 Jun 24 10:05:48.881814 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 298/592] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:48 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:05:49.898079 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-b237ffce-1bb6-4b1c-99ab-70b21449aca1 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:49.898729 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-b237ffce-1bb6-4b1c-99ab-70b21449aca1 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:49.906359 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b237ffce-1bb6-4b1c-99ab-70b21449aca1 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:49.906864 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b237ffce-1bb6-4b1c-99ab-70b21449aca1 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:49.907641 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b237ffce-1bb6-4b1c-99ab-70b21449aca1 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:49.908071 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b237ffce-1bb6-4b1c-99ab-70b21449aca1 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:50.088258 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-b237ffce-1bb6-4b1c-99ab-70b21449aca1 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:50.097514 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-b237ffce-1bb6-4b1c-99ab-70b21449aca1 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1756 microversion: 2.1 time: 0.203604 Jun 24 10:05:50.098111 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 295/593] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:49 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1756 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:05:51.125322 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-b93b83a8-895d-4709-aef8-f74f8042d1a1 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:51.127583 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-b93b83a8-895d-4709-aef8-f74f8042d1a1 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:51.135588 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b93b83a8-895d-4709-aef8-f74f8042d1a1 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:51.137072 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b93b83a8-895d-4709-aef8-f74f8042d1a1 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:51.137072 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b93b83a8-895d-4709-aef8-f74f8042d1a1 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:51.137849 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b93b83a8-895d-4709-aef8-f74f8042d1a1 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:51.317032 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-b93b83a8-895d-4709-aef8-f74f8042d1a1 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:51.325296 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-b93b83a8-895d-4709-aef8-f74f8042d1a1 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1756 microversion: 2.1 time: 0.207777 Jun 24 10:05:51.328460 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 299/594] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:51 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1756 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:05:52.087623 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-96a1be1f-4c83-4111-97ab-5f4ac8070b16 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:52.089469 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-96a1be1f-4c83-4111-97ab-5f4ac8070b16 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:52.100831 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-96a1be1f-4c83-4111-97ab-5f4ac8070b16 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:52.101632 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-96a1be1f-4c83-4111-97ab-5f4ac8070b16 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:52.102915 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-96a1be1f-4c83-4111-97ab-5f4ac8070b16 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:52.103643 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-96a1be1f-4c83-4111-97ab-5f4ac8070b16 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:52.150038 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-96a1be1f-4c83-4111-97ab-5f4ac8070b16 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877/os-volume_attachments/bef9b8ae-2c87-442c-b57f-6fc580beaab8" status: 200 len: 194 microversion: 2.20 time: 0.068380 Jun 24 10:05:52.150652 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 296/595] 10.222.0.26 () {60 vars in 1453 bytes} [Fri Jun 24 10:05:52 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877/os-volume_attachments/bef9b8ae-2c87-442c-b57f-6fc580beaab8 => generated 194 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 10:05:52.220108 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-9498e011-e3a6-4a2d-8299-209c7b1782b7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:52.220733 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-9498e011-e3a6-4a2d-8299-209c7b1782b7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:52.227214 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9498e011-e3a6-4a2d-8299-209c7b1782b7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:52.227659 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9498e011-e3a6-4a2d-8299-209c7b1782b7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:52.228458 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9498e011-e3a6-4a2d-8299-209c7b1782b7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:52.228890 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9498e011-e3a6-4a2d-8299-209c7b1782b7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:52.323257 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.objects.instance [None req-9498e011-e3a6-4a2d-8299-209c7b1782b7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lazy-loading 'services' on Instance uuid 904eb348-521e-499e-8127-cb3096230877 {{(pid=124979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:05:52.347086 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-f271691d-32cd-45cd-bda1-46ab0ec8ab5d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:52.347719 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-f271691d-32cd-45cd-bda1-46ab0ec8ab5d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:52.354987 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f271691d-32cd-45cd-bda1-46ab0ec8ab5d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:52.355439 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f271691d-32cd-45cd-bda1-46ab0ec8ab5d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:52.356867 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f271691d-32cd-45cd-bda1-46ab0ec8ab5d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:52.356867 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f271691d-32cd-45cd-bda1-46ab0ec8ab5d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:52.570398 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-f271691d-32cd-45cd-bda1-46ab0ec8ab5d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:52.570398 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-f271691d-32cd-45cd-bda1-46ab0ec8ab5d tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1756 microversion: 2.1 time: 0.222845 Jun 24 10:05:52.570398 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 297/596] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:52 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1756 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:05:52.635901 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-9498e011-e3a6-4a2d-8299-209c7b1782b7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "DELETE /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877/os-volume_attachments/bef9b8ae-2c87-442c-b57f-6fc580beaab8" status: 202 len: 0 microversion: 2.20 time: 0.419739 Jun 24 10:05:52.636782 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 300/597] 10.222.0.26 () {60 vars in 1456 bytes} [Fri Jun 24 10:05:52 2022] DELETE /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877/os-volume_attachments/bef9b8ae-2c87-442c-b57f-6fc580beaab8 => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:05:52.649731 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-2b4de99d-b022-4fdd-9e4e-a154d6744e84 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:52.651832 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-2b4de99d-b022-4fdd-9e4e-a154d6744e84 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:52.663487 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2b4de99d-b022-4fdd-9e4e-a154d6744e84 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:52.664397 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2b4de99d-b022-4fdd-9e4e-a154d6744e84 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:52.666049 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2b4de99d-b022-4fdd-9e4e-a154d6744e84 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:52.666863 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2b4de99d-b022-4fdd-9e4e-a154d6744e84 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:52.704108 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-2b4de99d-b022-4fdd-9e4e-a154d6744e84 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062012 Jun 24 10:05:52.708648 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 298/598] 10.222.0.26 () {60 vars in 1342 bytes} [Fri Jun 24 10:05:52 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 10:05:53.584424 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-8b18cff0-cf60-43f2-b0be-f7e89c489ded tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:53.585262 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-8b18cff0-cf60-43f2-b0be-f7e89c489ded tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:53.595907 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8b18cff0-cf60-43f2-b0be-f7e89c489ded tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:53.596976 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8b18cff0-cf60-43f2-b0be-f7e89c489ded tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:53.598451 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8b18cff0-cf60-43f2-b0be-f7e89c489ded tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:53.599016 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8b18cff0-cf60-43f2-b0be-f7e89c489ded tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:53.721559 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-1177b379-0b90-4fcb-941f-d2870fcbaaeb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:53.723256 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-1177b379-0b90-4fcb-941f-d2870fcbaaeb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:53.734287 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1177b379-0b90-4fcb-941f-d2870fcbaaeb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:53.734875 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1177b379-0b90-4fcb-941f-d2870fcbaaeb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:53.735779 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1177b379-0b90-4fcb-941f-d2870fcbaaeb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:53.736587 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1177b379-0b90-4fcb-941f-d2870fcbaaeb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:53.790953 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-1177b379-0b90-4fcb-941f-d2870fcbaaeb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076168 Jun 24 10:05:53.792044 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 299/599] 10.222.0.26 () {60 vars in 1342 bytes} [Fri Jun 24 10:05:53 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 10:05:53.794829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-8b18cff0-cf60-43f2-b0be-f7e89c489ded tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:53.810737 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-8b18cff0-cf60-43f2-b0be-f7e89c489ded tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1756 microversion: 2.1 time: 0.230621 Jun 24 10:05:53.812639 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 301/600] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:53 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1756 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:05:53.887605 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-8eac6b25-a371-4e50-86b1-dfbc49926242 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:53.888751 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-8eac6b25-a371-4e50-86b1-dfbc49926242 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:53.896207 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8eac6b25-a371-4e50-86b1-dfbc49926242 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:53.896634 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8eac6b25-a371-4e50-86b1-dfbc49926242 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:53.897404 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8eac6b25-a371-4e50-86b1-dfbc49926242 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:53.897836 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8eac6b25-a371-4e50-86b1-dfbc49926242 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:53.929549 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-8eac6b25-a371-4e50-86b1-dfbc49926242 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045848 Jun 24 10:05:53.930117 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 300/601] 10.222.0.26 () {58 vars in 1301 bytes} [Fri Jun 24 10:05:53 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 10:05:53.993447 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-7ebf8023-d15e-4427-9f75-ce5c39c58266 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:53.993914 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-7ebf8023-d15e-4427-9f75-ce5c39c58266 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:54.000304 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7ebf8023-d15e-4427-9f75-ce5c39c58266 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:54.001281 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7ebf8023-d15e-4427-9f75-ce5c39c58266 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:54.002052 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7ebf8023-d15e-4427-9f75-ce5c39c58266 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:54.002490 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7ebf8023-d15e-4427-9f75-ce5c39c58266 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:54.030856 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-7ebf8023-d15e-4427-9f75-ce5c39c58266 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Going to try to terminate instance {{(pid=124979) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:05:54.339372 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-7ebf8023-d15e-4427-9f75-ce5c39c58266 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "DELETE /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 204 len: 0 microversion: 2.1 time: 0.349519 Jun 24 10:05:54.340060 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 302/602] 10.222.0.26 () {58 vars in 1238 bytes} [Fri Jun 24 10:05:53 2022] DELETE /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:05:54.352245 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-ff6a8b45-7a5f-4cc9-9a03-1b997132f222 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:54.356449 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-ff6a8b45-7a5f-4cc9-9a03-1b997132f222 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:54.365367 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ff6a8b45-7a5f-4cc9-9a03-1b997132f222 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:54.366154 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ff6a8b45-7a5f-4cc9-9a03-1b997132f222 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:54.367498 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ff6a8b45-7a5f-4cc9-9a03-1b997132f222 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:54.368337 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ff6a8b45-7a5f-4cc9-9a03-1b997132f222 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:54.526223 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-ff6a8b45-7a5f-4cc9-9a03-1b997132f222 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:54.538512 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-ff6a8b45-7a5f-4cc9-9a03-1b997132f222 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1673 microversion: 2.1 time: 0.193491 Jun 24 10:05:54.539094 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 301/603] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:54 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1673 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:05:54.811554 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-80272699-f042-4d66-a072-897f6faea6d5 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:54.812759 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-80272699-f042-4d66-a072-897f6faea6d5 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:54.823717 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-80272699-f042-4d66-a072-897f6faea6d5 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:54.824596 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-80272699-f042-4d66-a072-897f6faea6d5 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:54.826049 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-80272699-f042-4d66-a072-897f6faea6d5 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:54.826829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-80272699-f042-4d66-a072-897f6faea6d5 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:54.839718 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-82408046-6911-4111-b3db-95e12c0bbcd8 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:54.840949 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-82408046-6911-4111-b3db-95e12c0bbcd8 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:54.852806 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-82408046-6911-4111-b3db-95e12c0bbcd8 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:54.853496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-82408046-6911-4111-b3db-95e12c0bbcd8 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:54.855135 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-82408046-6911-4111-b3db-95e12c0bbcd8 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:54.855938 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-82408046-6911-4111-b3db-95e12c0bbcd8 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:54.873995 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:05:54.883370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-80272699-f042-4d66-a072-897f6faea6d5 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076418 Jun 24 10:05:54.884941 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 303/604] 10.222.0.26 () {60 vars in 1342 bytes} [Fri Jun 24 10:05:54 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 10:05:55.062060 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-82408046-6911-4111-b3db-95e12c0bbcd8 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:55.070610 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-82408046-6911-4111-b3db-95e12c0bbcd8 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1756 microversion: 2.1 time: 0.238220 Jun 24 10:05:55.071185 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 302/605] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:54 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1756 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:05:55.561690 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-bf45f075-6565-468d-99f9-2df9d97e9570 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:55.562383 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-bf45f075-6565-468d-99f9-2df9d97e9570 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:55.570157 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-bf45f075-6565-468d-99f9-2df9d97e9570 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:55.570612 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-bf45f075-6565-468d-99f9-2df9d97e9570 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:55.571387 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-bf45f075-6565-468d-99f9-2df9d97e9570 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:55.571824 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-bf45f075-6565-468d-99f9-2df9d97e9570 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:55.721107 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-bf45f075-6565-468d-99f9-2df9d97e9570 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:55.728899 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-bf45f075-6565-468d-99f9-2df9d97e9570 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1673 microversion: 2.1 time: 0.171141 Jun 24 10:05:55.729582 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 304/606] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:55 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:05:55.835660 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-25780f3f-dc5c-4139-aa75-a44a89d7ee4d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2054062000", "imageRef": "f6b1dddb-2953-41a2-99e3-00aeca441bd9", "flavorRef": "452", "networks": [{"uuid": "27c1f451-5632-4595-bd92-6b71a74a8ba9"}]}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:05:55.901378 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.network.neutron [None req-25780f3f-dc5c-4139-aa75-a44a89d7ee4d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] validate_networks() for [('27c1f451-5632-4595-bd92-6b71a74a8ba9', None, None, None, None, None)] {{(pid=124980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:05:55.903202 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-c3ba9a1b-1831-4da4-b1d0-a88265c792c7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:55.904984 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-c3ba9a1b-1831-4da4-b1d0-a88265c792c7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:55.916760 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c3ba9a1b-1831-4da4-b1d0-a88265c792c7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:55.917565 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c3ba9a1b-1831-4da4-b1d0-a88265c792c7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:55.918919 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c3ba9a1b-1831-4da4-b1d0-a88265c792c7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:55.919707 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c3ba9a1b-1831-4da4-b1d0-a88265c792c7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:55.979220 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-c3ba9a1b-1831-4da4-b1d0-a88265c792c7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083765 Jun 24 10:05:55.979878 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 305/607] 10.222.0.26 () {60 vars in 1342 bytes} [Fri Jun 24 10:05:55 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 10:05:56.093122 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-974ce16a-db13-4e31-81b5-57834a282b50 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:56.093122 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-974ce16a-db13-4e31-81b5-57834a282b50 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:56.097124 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-974ce16a-db13-4e31-81b5-57834a282b50 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:56.097573 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-974ce16a-db13-4e31-81b5-57834a282b50 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:56.098349 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-974ce16a-db13-4e31-81b5-57834a282b50 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:56.098791 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-974ce16a-db13-4e31-81b5-57834a282b50 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:56.308836 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-974ce16a-db13-4e31-81b5-57834a282b50 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:56.318060 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-974ce16a-db13-4e31-81b5-57834a282b50 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1756 microversion: 2.1 time: 0.233907 Jun 24 10:05:56.318656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 306/608] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:56 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1756 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:05:56.373611 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-25780f3f-dc5c-4139-aa75-a44a89d7ee4d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Flavor limits 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:05:56.374039 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-25780f3f-dc5c-4139-aa75-a44a89d7ee4d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Image limits 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:05:56.374566 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-25780f3f-dc5c-4139-aa75-a44a89d7ee4d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Flavor pref 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:05:56.374984 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-25780f3f-dc5c-4139-aa75-a44a89d7ee4d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Image pref 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:05:56.376037 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-25780f3f-dc5c-4139-aa75-a44a89d7ee4d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:05:56.386698 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-25780f3f-dc5c-4139-aa75-a44a89d7ee4d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:56.387150 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-25780f3f-dc5c-4139-aa75-a44a89d7ee4d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:56.387997 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-25780f3f-dc5c-4139-aa75-a44a89d7ee4d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:56.388502 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-25780f3f-dc5c-4139-aa75-a44a89d7ee4d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:56.408882 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-25780f3f-dc5c-4139-aa75-a44a89d7ee4d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Getting quotas for project 28def10792f645c491f98a134ff71dce. Resources: {'instances', 'cores', 'ram'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:05:56.413383 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-25780f3f-dc5c-4139-aa75-a44a89d7ee4d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Getting quotas for user cec38b1840f448e5a585469900801917 and project 28def10792f645c491f98a134ff71dce. Resources: {'instances', 'cores', 'ram'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:05:56.426042 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-25780f3f-dc5c-4139-aa75-a44a89d7ee4d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Going to run 1 instances... {{(pid=124980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:05:56.428381 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-25780f3f-dc5c-4139-aa75-a44a89d7ee4d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: eaab6bae-ac96-452b-9d70-dded946abf05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6b1dddb-2953-41a2-99e3-00aeca441bd9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:05:56.628604 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-25780f3f-dc5c-4139-aa75-a44a89d7ee4d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.796833 Jun 24 10:05:56.629573 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 303/609] 10.222.0.26 () {60 vars in 1146 bytes} [Fri Jun 24 10:05:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 10:05:56.639799 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-669dd5cb-b29e-4a82-a223-eec543818cb5 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:56.640456 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-669dd5cb-b29e-4a82-a223-eec543818cb5 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: eaab6bae-ac96-452b-9d70-dded946abf05] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:56.717054 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-669dd5cb-b29e-4a82-a223-eec543818cb5 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:56.728176 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-669dd5cb-b29e-4a82-a223-eec543818cb5 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05" status: 200 len: 1219 microversion: 2.1 time: 0.091727 Jun 24 10:05:56.730468 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 307/610] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:56 2022] GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:05:56.747768 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-d865ac34-5c6a-4a5e-ad3e-2aee59318d28 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:56.748435 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-d865ac34-5c6a-4a5e-ad3e-2aee59318d28 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:56.755888 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d865ac34-5c6a-4a5e-ad3e-2aee59318d28 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:56.756411 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d865ac34-5c6a-4a5e-ad3e-2aee59318d28 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:56.757222 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d865ac34-5c6a-4a5e-ad3e-2aee59318d28 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:56.757675 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d865ac34-5c6a-4a5e-ad3e-2aee59318d28 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:56.932110 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d865ac34-5c6a-4a5e-ad3e-2aee59318d28 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:56.940314 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-d865ac34-5c6a-4a5e-ad3e-2aee59318d28 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1673 microversion: 2.1 time: 0.197084 Jun 24 10:05:56.940899 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 304/611] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:56 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1673 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:05:56.996955 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-e81e5b97-d243-442b-b28a-ca326fcd00db tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:56.998975 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-e81e5b97-d243-442b-b28a-ca326fcd00db tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:57.012991 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e81e5b97-d243-442b-b28a-ca326fcd00db tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:57.014010 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e81e5b97-d243-442b-b28a-ca326fcd00db tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:57.015297 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e81e5b97-d243-442b-b28a-ca326fcd00db tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:57.016059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e81e5b97-d243-442b-b28a-ca326fcd00db tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:57.069205 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-e81e5b97-d243-442b-b28a-ca326fcd00db tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079685 Jun 24 10:05:57.070186 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 308/612] 10.222.0.26 () {60 vars in 1342 bytes} [Fri Jun 24 10:05:56 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:05:57.346813 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-9340e044-b7e2-4e4a-aca3-27cf636027fa tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:57.348538 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-9340e044-b7e2-4e4a-aca3-27cf636027fa tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:57.360051 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9340e044-b7e2-4e4a-aca3-27cf636027fa tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:57.360993 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9340e044-b7e2-4e4a-aca3-27cf636027fa tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:57.362264 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9340e044-b7e2-4e4a-aca3-27cf636027fa tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:57.363056 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9340e044-b7e2-4e4a-aca3-27cf636027fa tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:57.370271 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:05:57.572656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-ab64aa0e-7910-474f-ae3f-961b2fc4a890 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:57.582569 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-ab64aa0e-7910-474f-ae3f-961b2fc4a890 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:57.584858 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ab64aa0e-7910-474f-ae3f-961b2fc4a890 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:57.585673 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ab64aa0e-7910-474f-ae3f-961b2fc4a890 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:57.587442 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ab64aa0e-7910-474f-ae3f-961b2fc4a890 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:57.588280 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ab64aa0e-7910-474f-ae3f-961b2fc4a890 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:57.710037 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.objects.instance [None req-ab64aa0e-7910-474f-ae3f-961b2fc4a890 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lazy-loading 'services' on Instance uuid c170d532-d8da-4b26-879d-22c7dc180716 {{(pid=124979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:05:57.784051 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-9340e044-b7e2-4e4a-aca3-27cf636027fa tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:57.796310 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-9340e044-b7e2-4e4a-aca3-27cf636027fa tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1756 microversion: 2.1 time: 0.457146 Jun 24 10:05:57.797909 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 305/613] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:57 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1756 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:05:57.806623 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-23eb9f49-c25e-47cd-87e4-a64003755f39 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:57.807800 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-23eb9f49-c25e-47cd-87e4-a64003755f39 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: eaab6bae-ac96-452b-9d70-dded946abf05] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:57.819790 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-23eb9f49-c25e-47cd-87e4-a64003755f39 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:57.820552 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-23eb9f49-c25e-47cd-87e4-a64003755f39 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:57.821627 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-23eb9f49-c25e-47cd-87e4-a64003755f39 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:57.822320 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-23eb9f49-c25e-47cd-87e4-a64003755f39 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:58.152763 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-23eb9f49-c25e-47cd-87e4-a64003755f39 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:58.167579 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-23eb9f49-c25e-47cd-87e4-a64003755f39 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05" status: 200 len: 1223 microversion: 2.1 time: 0.367456 Jun 24 10:05:58.168921 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 306/614] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:57 2022] GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05 => generated 1223 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:05:58.178347 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-00eddf5c-5894-4fde-9ffb-de851b1085a2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:58.179494 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-00eddf5c-5894-4fde-9ffb-de851b1085a2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:58.191184 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-00eddf5c-5894-4fde-9ffb-de851b1085a2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:58.196849 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-00eddf5c-5894-4fde-9ffb-de851b1085a2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:58.196849 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-00eddf5c-5894-4fde-9ffb-de851b1085a2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:58.197194 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-00eddf5c-5894-4fde-9ffb-de851b1085a2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:58.306988 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-ab64aa0e-7910-474f-ae3f-961b2fc4a890 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716/os-volume_attachments/2828bffb-c5ff-4336-bda3-a98f1e2b3f67" status: 202 len: 0 microversion: 2.1 time: 0.741545 Jun 24 10:05:58.308075 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 309/615] 10.222.0.26 () {58 vars in 1415 bytes} [Fri Jun 24 10:05:57 2022] DELETE /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716/os-volume_attachments/2828bffb-c5ff-4336-bda3-a98f1e2b3f67 => generated 0 bytes in 745 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 10:05:58.319372 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-db1f9a30-4984-4314-8b88-8a1150f1ae1d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:58.321447 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-db1f9a30-4984-4314-8b88-8a1150f1ae1d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:58.337405 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-db1f9a30-4984-4314-8b88-8a1150f1ae1d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:58.338152 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-db1f9a30-4984-4314-8b88-8a1150f1ae1d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:58.339324 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-db1f9a30-4984-4314-8b88-8a1150f1ae1d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:58.339947 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-db1f9a30-4984-4314-8b88-8a1150f1ae1d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:58.389891 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-db1f9a30-4984-4314-8b88-8a1150f1ae1d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079567 Jun 24 10:05:58.390972 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 310/616] 10.222.0.26 () {60 vars in 1342 bytes} [Fri Jun 24 10:05:58 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:05:58.399098 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-594c37eb-9e07-4828-979a-7ea78c94f387 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:58.400999 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-594c37eb-9e07-4828-979a-7ea78c94f387 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:58.409519 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-594c37eb-9e07-4828-979a-7ea78c94f387 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:58.410140 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-594c37eb-9e07-4828-979a-7ea78c94f387 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:58.412875 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-594c37eb-9e07-4828-979a-7ea78c94f387 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:58.412875 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-594c37eb-9e07-4828-979a-7ea78c94f387 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:58.470592 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-594c37eb-9e07-4828-979a-7ea78c94f387 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077588 Jun 24 10:05:58.475104 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 311/617] 10.222.0.26 () {58 vars in 1301 bytes} [Fri Jun 24 10:05:58 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:05:58.530097 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-00eddf5c-5894-4fde-9ffb-de851b1085a2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:58.541942 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-00eddf5c-5894-4fde-9ffb-de851b1085a2 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1673 microversion: 2.1 time: 0.371256 Jun 24 10:05:58.542958 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 307/618] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:58 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1673 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:05:58.825694 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-b9b440e6-61c1-4e07-a8b8-25cdaafdb524 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:58.826500 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-b9b440e6-61c1-4e07-a8b8-25cdaafdb524 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:58.835883 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b9b440e6-61c1-4e07-a8b8-25cdaafdb524 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:58.836493 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b9b440e6-61c1-4e07-a8b8-25cdaafdb524 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:58.837438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b9b440e6-61c1-4e07-a8b8-25cdaafdb524 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:58.838018 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b9b440e6-61c1-4e07-a8b8-25cdaafdb524 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:59.032662 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-b9b440e6-61c1-4e07-a8b8-25cdaafdb524 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:59.046516 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-b9b440e6-61c1-4e07-a8b8-25cdaafdb524 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1759 microversion: 2.1 time: 0.224857 Jun 24 10:05:59.051155 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 312/619] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:58 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1759 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:05:59.227564 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-07e74fac-44f6-4508-903d-8b2896a7fcd8 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:59.227564 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-07e74fac-44f6-4508-903d-8b2896a7fcd8 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: eaab6bae-ac96-452b-9d70-dded946abf05] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:59.227564 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-07e74fac-44f6-4508-903d-8b2896a7fcd8 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:59.227564 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-07e74fac-44f6-4508-903d-8b2896a7fcd8 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:59.229020 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-07e74fac-44f6-4508-903d-8b2896a7fcd8 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:59.229020 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-07e74fac-44f6-4508-903d-8b2896a7fcd8 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:59.349260 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-07e74fac-44f6-4508-903d-8b2896a7fcd8 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:59.362591 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-07e74fac-44f6-4508-903d-8b2896a7fcd8 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05" status: 200 len: 1271 microversion: 2.1 time: 0.175282 Jun 24 10:05:59.363826 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 308/620] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:59 2022] GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05 => generated 1271 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:05:59.406240 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-01ea8510-738a-4aa3-9218-a554bb18e7dc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:59.409249 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-01ea8510-738a-4aa3-9218-a554bb18e7dc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:59.422807 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-01ea8510-738a-4aa3-9218-a554bb18e7dc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:59.431749 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-01ea8510-738a-4aa3-9218-a554bb18e7dc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:59.431749 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-01ea8510-738a-4aa3-9218-a554bb18e7dc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:59.431749 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-01ea8510-738a-4aa3-9218-a554bb18e7dc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:59.469271 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-1adbfbf5-b764-4def-9618-d9821271b452 req-a9089f04-40bf-4642-b950-36e9d1d66903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84bc600e-1c87-4ba3-9dfa-421ee774e45e", "name": "network-vif-deleted", "tag": "9e3214ad-2d0a-4c9c-aa84-e405ba29e4b8"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:05:59.471341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-01ea8510-738a-4aa3-9218-a554bb18e7dc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.070407 Jun 24 10:05:59.477920 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 313/621] 10.222.0.26 () {60 vars in 1342 bytes} [Fri Jun 24 10:05:59 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:05:59.493772 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-1adbfbf5-b764-4def-9618-d9821271b452 req-a9089f04-40bf-4642-b950-36e9d1d66903 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:59.496737 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-1adbfbf5-b764-4def-9618-d9821271b452 req-a9089f04-40bf-4642-b950-36e9d1d66903 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:59.504229 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-9d6b0535-2543-41b7-a8c9-ba604f728203 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:59.505554 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-9d6b0535-2543-41b7-a8c9-ba604f728203 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:59.522020 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9d6b0535-2543-41b7-a8c9-ba604f728203 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:59.524992 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9d6b0535-2543-41b7-a8c9-ba604f728203 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:59.527847 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9d6b0535-2543-41b7-a8c9-ba604f728203 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:59.529756 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9d6b0535-2543-41b7-a8c9-ba604f728203 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:59.533139 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-1adbfbf5-b764-4def-9618-d9821271b452 req-a9089f04-40bf-4642-b950-36e9d1d66903 service nova] Creating event network-vif-deleted:9e3214ad-2d0a-4c9c-aa84-e405ba29e4b8 for instance 84bc600e-1c87-4ba3-9dfa-421ee774e45e on hv-cinder-84327 Jun 24 10:05:59.549270 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-1adbfbf5-b764-4def-9618-d9821271b452 req-a9089f04-40bf-4642-b950-36e9d1d66903 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084491 Jun 24 10:05:59.554348 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 309/622] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:05:59.580403 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-be290651-8669-4317-baee-926fbfa36134 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:59.584847 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-be290651-8669-4317-baee-926fbfa36134 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:59.588346 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-9d6b0535-2543-41b7-a8c9-ba604f728203 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096907 Jun 24 10:05:59.589533 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 314/623] 10.222.0.26 () {58 vars in 1301 bytes} [Fri Jun 24 10:05:59 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:05:59.600636 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-d803b75c-02c3-4c52-a7a3-cac1346c3d15 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:05:59.602779 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-d803b75c-02c3-4c52-a7a3-cac1346c3d15 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:05:59.611751 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d803b75c-02c3-4c52-a7a3-cac1346c3d15 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:59.613929 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-be290651-8669-4317-baee-926fbfa36134 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:59.614918 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d803b75c-02c3-4c52-a7a3-cac1346c3d15 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:59.617194 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d803b75c-02c3-4c52-a7a3-cac1346c3d15 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:59.618405 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d803b75c-02c3-4c52-a7a3-cac1346c3d15 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:59.619452 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-be290651-8669-4317-baee-926fbfa36134 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:59.621152 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-be290651-8669-4317-baee-926fbfa36134 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:05:59.623276 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-be290651-8669-4317-baee-926fbfa36134 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:05:59.700157 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-d803b75c-02c3-4c52-a7a3-cac1346c3d15 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Going to try to terminate instance {{(pid=124979) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:05:59.842198 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-be290651-8669-4317-baee-926fbfa36134 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:05:59.859709 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-be290651-8669-4317-baee-926fbfa36134 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1606 microversion: 2.1 time: 0.291939 Jun 24 10:05:59.862374 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 310/624] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:05:59 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1606 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:06:00.182858 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-d803b75c-02c3-4c52-a7a3-cac1346c3d15 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "DELETE /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 204 len: 0 microversion: 2.20 time: 0.583538 Jun 24 10:06:00.182858 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 315/625] 10.222.0.26 () {60 vars in 1279 bytes} [Fri Jun 24 10:05:59 2022] DELETE /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 10:06:00.190872 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-9bb83906-672c-4347-bc12-e2e939ca026b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:00.191892 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-9bb83906-672c-4347-bc12-e2e939ca026b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:00.201012 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9bb83906-672c-4347-bc12-e2e939ca026b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:00.201841 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9bb83906-672c-4347-bc12-e2e939ca026b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:00.204012 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9bb83906-672c-4347-bc12-e2e939ca026b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:00.204811 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9bb83906-672c-4347-bc12-e2e939ca026b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:00.382113 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-4dddd461-f1af-4a29-b480-d8af1e2e57df tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:00.382837 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-4dddd461-f1af-4a29-b480-d8af1e2e57df tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: eaab6bae-ac96-452b-9d70-dded946abf05] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:00.390268 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4dddd461-f1af-4a29-b480-d8af1e2e57df tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:00.392177 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4dddd461-f1af-4a29-b480-d8af1e2e57df tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:00.392432 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4dddd461-f1af-4a29-b480-d8af1e2e57df tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:00.392725 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4dddd461-f1af-4a29-b480-d8af1e2e57df tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:00.467097 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-4dddd461-f1af-4a29-b480-d8af1e2e57df tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:00.477351 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-4dddd461-f1af-4a29-b480-d8af1e2e57df tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05" status: 200 len: 1277 microversion: 2.1 time: 0.099580 Jun 24 10:06:00.489647 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 316/626] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:00 2022] GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05 => generated 1277 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:06:00.499196 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-9bb83906-672c-4347-bc12-e2e939ca026b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:00.517998 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-9bb83906-672c-4347-bc12-e2e939ca026b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:00.520720 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-9bb83906-672c-4347-bc12-e2e939ca026b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:00.522105 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-9bb83906-672c-4347-bc12-e2e939ca026b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1721 microversion: 2.20 time: 0.336468 Jun 24 10:06:00.523225 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 311/627] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:06:00 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1721 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:06:00.616035 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-e0909cac-e586-4a99-a094-ff8cf85808d8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:00.617835 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-e0909cac-e586-4a99-a094-ff8cf85808d8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:00.628707 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e0909cac-e586-4a99-a094-ff8cf85808d8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:00.633463 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e0909cac-e586-4a99-a094-ff8cf85808d8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:00.634636 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e0909cac-e586-4a99-a094-ff8cf85808d8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:00.635333 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e0909cac-e586-4a99-a094-ff8cf85808d8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:00.694544 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-e0909cac-e586-4a99-a094-ff8cf85808d8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092450 Jun 24 10:06:00.698774 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 317/628] 10.222.0.26 () {58 vars in 1301 bytes} [Fri Jun 24 10:06:00 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 10:06:00.809306 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-90d5008f-b18e-4a75-9e27-19c6263ead0e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:00.810694 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-90d5008f-b18e-4a75-9e27-19c6263ead0e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:00.824838 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-90d5008f-b18e-4a75-9e27-19c6263ead0e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:00.825742 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-90d5008f-b18e-4a75-9e27-19c6263ead0e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:00.827589 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-90d5008f-b18e-4a75-9e27-19c6263ead0e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:00.829028 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-90d5008f-b18e-4a75-9e27-19c6263ead0e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:00.881259 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-90d5008f-b18e-4a75-9e27-19c6263ead0e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Going to try to terminate instance {{(pid=124980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:06:00.895467 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-ba9708dd-cc46-4693-a8ff-addf09dc118f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:00.896667 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-ba9708dd-cc46-4693-a8ff-addf09dc118f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:00.916264 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ba9708dd-cc46-4693-a8ff-addf09dc118f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:00.916787 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ba9708dd-cc46-4693-a8ff-addf09dc118f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:00.919963 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ba9708dd-cc46-4693-a8ff-addf09dc118f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:00.921279 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ba9708dd-cc46-4693-a8ff-addf09dc118f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:00.988621 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ba9708dd-cc46-4693-a8ff-addf09dc118f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:00.989229 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ba9708dd-cc46-4693-a8ff-addf09dc118f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:00.990399 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.objects.instance [None req-ba9708dd-cc46-4693-a8ff-addf09dc118f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lazy-loading 'fault' on Instance uuid 84bc600e-1c87-4ba3-9dfa-421ee774e45e {{(pid=124979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:06:01.086206 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-ba9708dd-cc46-4693-a8ff-addf09dc118f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:01.091754 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:06:01.104270 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-ba9708dd-cc46-4693-a8ff-addf09dc118f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1327 microversion: 2.1 time: 0.216105 Jun 24 10:06:01.108192 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 318/629] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:00 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1327 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:01.407882 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-90d5008f-b18e-4a75-9e27-19c6263ead0e tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 204 len: 0 microversion: 2.1 time: 0.610801 Jun 24 10:06:01.408453 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 312/630] 10.222.0.26 () {58 vars in 1238 bytes} [Fri Jun 24 10:06:00 2022] DELETE /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 10:06:01.417749 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-57667e78-dc22-4d17-b833-1caed9ba10c1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:01.418615 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-57667e78-dc22-4d17-b833-1caed9ba10c1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:01.430743 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-57667e78-dc22-4d17-b833-1caed9ba10c1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:01.431498 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-57667e78-dc22-4d17-b833-1caed9ba10c1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:01.432775 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-57667e78-dc22-4d17-b833-1caed9ba10c1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:01.433238 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-57667e78-dc22-4d17-b833-1caed9ba10c1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:01.496261 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-52a0e5d1-6866-456f-96e6-e2037e199870 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:01.496993 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-52a0e5d1-6866-456f-96e6-e2037e199870 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: eaab6bae-ac96-452b-9d70-dded946abf05] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:01.506284 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-52a0e5d1-6866-456f-96e6-e2037e199870 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:01.506965 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-52a0e5d1-6866-456f-96e6-e2037e199870 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:01.508113 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-52a0e5d1-6866-456f-96e6-e2037e199870 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:01.508644 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-52a0e5d1-6866-456f-96e6-e2037e199870 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:01.666573 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-57667e78-dc22-4d17-b833-1caed9ba10c1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:01.680939 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-57667e78-dc22-4d17-b833-1caed9ba10c1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1688 microversion: 2.1 time: 0.267748 Jun 24 10:06:01.683123 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 319/631] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:01 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1688 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:06:01.713094 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-ada8ca68-630f-46ce-9b74-501058b12b4c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:01.714021 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-ada8ca68-630f-46ce-9b74-501058b12b4c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:01.724723 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ada8ca68-630f-46ce-9b74-501058b12b4c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:01.725558 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ada8ca68-630f-46ce-9b74-501058b12b4c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:01.726397 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ada8ca68-630f-46ce-9b74-501058b12b4c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:01.726844 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ada8ca68-630f-46ce-9b74-501058b12b4c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:01.891069 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-ada8ca68-630f-46ce-9b74-501058b12b4c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:01.899638 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-ada8ca68-630f-46ce-9b74-501058b12b4c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:01.901225 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-ada8ca68-630f-46ce-9b74-501058b12b4c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:01.902442 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-ada8ca68-630f-46ce-9b74-501058b12b4c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1721 microversion: 2.20 time: 0.212755 Jun 24 10:06:01.903330 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 320/632] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:06:01 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1721 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:06:01.937496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-52a0e5d1-6866-456f-96e6-e2037e199870 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:01.946723 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-52a0e5d1-6866-456f-96e6-e2037e199870 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05" status: 200 len: 1319 microversion: 2.1 time: 0.455446 Jun 24 10:06:01.947314 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 313/633] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:01 2022] GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05 => generated 1319 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:06:02.130137 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-e1b601c4-bbe0-4866-a0a2-7df28205912b tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:02.131357 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-e1b601c4-bbe0-4866-a0a2-7df28205912b tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:02.146802 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e1b601c4-bbe0-4866-a0a2-7df28205912b tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:02.147618 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e1b601c4-bbe0-4866-a0a2-7df28205912b tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:02.149087 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e1b601c4-bbe0-4866-a0a2-7df28205912b tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:02.149888 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e1b601c4-bbe0-4866-a0a2-7df28205912b tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:02.206852 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e1b601c4-bbe0-4866-a0a2-7df28205912b tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:02.207613 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e1b601c4-bbe0-4866-a0a2-7df28205912b tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:02.208487 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.objects.instance [None req-e1b601c4-bbe0-4866-a0a2-7df28205912b tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lazy-loading 'fault' on Instance uuid 84bc600e-1c87-4ba3-9dfa-421ee774e45e {{(pid=124979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:06:02.259946 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-e1b601c4-bbe0-4866-a0a2-7df28205912b tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:02.267973 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-e1b601c4-bbe0-4866-a0a2-7df28205912b tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1327 microversion: 2.1 time: 0.142056 Jun 24 10:06:02.268595 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 321/634] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:02 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1327 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:02.705836 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-c3acda66-d0be-4047-96c5-c19a92fa865c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:02.706555 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-c3acda66-d0be-4047-96c5-c19a92fa865c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:02.727745 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c3acda66-d0be-4047-96c5-c19a92fa865c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:02.728172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c3acda66-d0be-4047-96c5-c19a92fa865c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:02.729231 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c3acda66-d0be-4047-96c5-c19a92fa865c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:02.729686 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c3acda66-d0be-4047-96c5-c19a92fa865c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:02.784342 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-98c0e702-5fde-4f0d-aa4c-a674b4877ee9 req-925fe5ea-5a48-407b-a52e-9fc3d3fb68d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaab6bae-ac96-452b-9d70-dded946abf05", "tag": "09666df1-84b4-415c-9fc9-228adfcfdef3"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:06:02.790911 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-98c0e702-5fde-4f0d-aa4c-a674b4877ee9 req-925fe5ea-5a48-407b-a52e-9fc3d3fb68d4 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:02.793515 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-98c0e702-5fde-4f0d-aa4c-a674b4877ee9 req-925fe5ea-5a48-407b-a52e-9fc3d3fb68d4 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:02.805091 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-98c0e702-5fde-4f0d-aa4c-a674b4877ee9 req-925fe5ea-5a48-407b-a52e-9fc3d3fb68d4 service nova] Creating event network-changed:09666df1-84b4-415c-9fc9-228adfcfdef3 for instance eaab6bae-ac96-452b-9d70-dded946abf05 on hv-cinder-84327 Jun 24 10:06:02.812157 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-98c0e702-5fde-4f0d-aa4c-a674b4877ee9 req-925fe5ea-5a48-407b-a52e-9fc3d3fb68d4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040983 Jun 24 10:06:02.813920 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 322/635] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:06:02.916271 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-c3acda66-d0be-4047-96c5-c19a92fa865c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:02.923625 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-5dec5eaa-1a9a-4d16-9f09-bfd7fa3a633e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:02.924516 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-5dec5eaa-1a9a-4d16-9f09-bfd7fa3a633e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:02.925117 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-c3acda66-d0be-4047-96c5-c19a92fa865c tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1688 microversion: 2.1 time: 0.224130 Jun 24 10:06:02.927349 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 314/636] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:02 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1688 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:02.931479 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5dec5eaa-1a9a-4d16-9f09-bfd7fa3a633e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:02.932041 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5dec5eaa-1a9a-4d16-9f09-bfd7fa3a633e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:02.933426 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5dec5eaa-1a9a-4d16-9f09-bfd7fa3a633e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:02.934250 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5dec5eaa-1a9a-4d16-9f09-bfd7fa3a633e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:02.965437 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-79f1889a-3b33-4690-9108-930fe8f07070 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:02.966342 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-79f1889a-3b33-4690-9108-930fe8f07070 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: eaab6bae-ac96-452b-9d70-dded946abf05] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:02.972866 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-79f1889a-3b33-4690-9108-930fe8f07070 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:02.973319 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-79f1889a-3b33-4690-9108-930fe8f07070 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:02.974104 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-79f1889a-3b33-4690-9108-930fe8f07070 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:02.974541 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-79f1889a-3b33-4690-9108-930fe8f07070 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:03.117866 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-5dec5eaa-1a9a-4d16-9f09-bfd7fa3a633e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:03.131690 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-5dec5eaa-1a9a-4d16-9f09-bfd7fa3a633e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:03.133492 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-5dec5eaa-1a9a-4d16-9f09-bfd7fa3a633e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:03.135376 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-5dec5eaa-1a9a-4d16-9f09-bfd7fa3a633e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1721 microversion: 2.20 time: 0.216272 Jun 24 10:06:03.136611 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 323/637] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:06:02 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1721 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:06:03.147041 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-79f1889a-3b33-4690-9108-930fe8f07070 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:03.155212 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-79f1889a-3b33-4690-9108-930fe8f07070 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05" status: 200 len: 1319 microversion: 2.1 time: 0.193669 Jun 24 10:06:03.155792 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 315/638] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:02 2022] GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:06:03.285124 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-4e82b265-a8a5-4ab8-9734-b348e56afcb4 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:03.285733 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-4e82b265-a8a5-4ab8-9734-b348e56afcb4 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:03.292736 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4e82b265-a8a5-4ab8-9734-b348e56afcb4 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:03.293183 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4e82b265-a8a5-4ab8-9734-b348e56afcb4 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:03.293958 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4e82b265-a8a5-4ab8-9734-b348e56afcb4 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:03.294394 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4e82b265-a8a5-4ab8-9734-b348e56afcb4 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:03.332311 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4e82b265-a8a5-4ab8-9734-b348e56afcb4 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:03.332650 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4e82b265-a8a5-4ab8-9734-b348e56afcb4 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:03.333105 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.objects.instance [None req-4e82b265-a8a5-4ab8-9734-b348e56afcb4 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lazy-loading 'fault' on Instance uuid 84bc600e-1c87-4ba3-9dfa-421ee774e45e {{(pid=124979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:06:03.380003 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-4e82b265-a8a5-4ab8-9734-b348e56afcb4 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:03.390470 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-4e82b265-a8a5-4ab8-9734-b348e56afcb4 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1327 microversion: 2.1 time: 0.109119 Jun 24 10:06:03.391422 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 324/639] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:03 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1327 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:03.941524 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-7a65a8d0-bb84-4a73-a923-b8e7fd477580 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:03.942096 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-7a65a8d0-bb84-4a73-a923-b8e7fd477580 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:03.948867 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7a65a8d0-bb84-4a73-a923-b8e7fd477580 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:03.949318 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7a65a8d0-bb84-4a73-a923-b8e7fd477580 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:03.950102 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7a65a8d0-bb84-4a73-a923-b8e7fd477580 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:03.950539 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7a65a8d0-bb84-4a73-a923-b8e7fd477580 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:04.092204 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-7a65a8d0-bb84-4a73-a923-b8e7fd477580 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:04.101521 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-7a65a8d0-bb84-4a73-a923-b8e7fd477580 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1688 microversion: 2.1 time: 0.163810 Jun 24 10:06:04.103748 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 316/640] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:03 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:04.160659 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-bfd731fa-7fe5-4f29-9b37-d6d4ff5572bd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:04.161594 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-bfd731fa-7fe5-4f29-9b37-d6d4ff5572bd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:04.172589 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-bfd731fa-7fe5-4f29-9b37-d6d4ff5572bd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:04.173398 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-bfd731fa-7fe5-4f29-9b37-d6d4ff5572bd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:04.174826 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-bfd731fa-7fe5-4f29-9b37-d6d4ff5572bd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:04.175600 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-bfd731fa-7fe5-4f29-9b37-d6d4ff5572bd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:04.176423 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-ca4ae04b-58e0-4f09-bf7c-88f188cee0b8 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:04.177051 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-ca4ae04b-58e0-4f09-bf7c-88f188cee0b8 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: eaab6bae-ac96-452b-9d70-dded946abf05] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:04.183364 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ca4ae04b-58e0-4f09-bf7c-88f188cee0b8 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:04.183809 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ca4ae04b-58e0-4f09-bf7c-88f188cee0b8 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:04.184613 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ca4ae04b-58e0-4f09-bf7c-88f188cee0b8 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:04.185049 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ca4ae04b-58e0-4f09-bf7c-88f188cee0b8 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:04.329060 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-bfd731fa-7fe5-4f29-9b37-d6d4ff5572bd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:04.341877 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-bfd731fa-7fe5-4f29-9b37-d6d4ff5572bd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:04.343738 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-bfd731fa-7fe5-4f29-9b37-d6d4ff5572bd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:04.345015 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-bfd731fa-7fe5-4f29-9b37-d6d4ff5572bd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1721 microversion: 2.20 time: 0.188910 Jun 24 10:06:04.345675 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 325/641] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:06:04 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:06:04.347070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-ca4ae04b-58e0-4f09-bf7c-88f188cee0b8 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:04.355812 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-ca4ae04b-58e0-4f09-bf7c-88f188cee0b8 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05" status: 200 len: 1319 microversion: 2.1 time: 0.186530 Jun 24 10:06:04.356432 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 317/642] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:04 2022] GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:04.407586 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-59b95e29-1a23-45bd-8d42-2b6b3a6284a6 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:04.408254 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-59b95e29-1a23-45bd-8d42-2b6b3a6284a6 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:04.414824 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-59b95e29-1a23-45bd-8d42-2b6b3a6284a6 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:04.415319 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-59b95e29-1a23-45bd-8d42-2b6b3a6284a6 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:04.416115 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-59b95e29-1a23-45bd-8d42-2b6b3a6284a6 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:04.416585 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-59b95e29-1a23-45bd-8d42-2b6b3a6284a6 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:04.452626 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-59b95e29-1a23-45bd-8d42-2b6b3a6284a6 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:04.453072 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-59b95e29-1a23-45bd-8d42-2b6b3a6284a6 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:04.454099 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.objects.instance [None req-59b95e29-1a23-45bd-8d42-2b6b3a6284a6 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lazy-loading 'fault' on Instance uuid 84bc600e-1c87-4ba3-9dfa-421ee774e45e {{(pid=124979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:06:04.496238 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-59b95e29-1a23-45bd-8d42-2b6b3a6284a6 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:04.504631 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-59b95e29-1a23-45bd-8d42-2b6b3a6284a6 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 200 len: 1327 microversion: 2.1 time: 0.100971 Jun 24 10:06:04.505231 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 326/643] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:04 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:05.123216 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-0f4fb21a-7806-492d-a9ad-96660fce7898 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:05.124037 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-0f4fb21a-7806-492d-a9ad-96660fce7898 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:05.141697 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0f4fb21a-7806-492d-a9ad-96660fce7898 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:05.142167 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0f4fb21a-7806-492d-a9ad-96660fce7898 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:05.142954 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0f4fb21a-7806-492d-a9ad-96660fce7898 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:05.143403 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0f4fb21a-7806-492d-a9ad-96660fce7898 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:05.327669 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-0f4fb21a-7806-492d-a9ad-96660fce7898 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:05.337124 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-0f4fb21a-7806-492d-a9ad-96660fce7898 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1688 microversion: 2.1 time: 0.219446 Jun 24 10:06:05.337710 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 318/644] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:05 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1688 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:05.363641 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-eb8f2dcb-cfdb-4229-a045-f93f2b7da023 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:05.365037 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-eb8f2dcb-cfdb-4229-a045-f93f2b7da023 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:05.372038 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-eb8f2dcb-cfdb-4229-a045-f93f2b7da023 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:05.372761 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-eb8f2dcb-cfdb-4229-a045-f93f2b7da023 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:05.373761 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-eb8f2dcb-cfdb-4229-a045-f93f2b7da023 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:05.374384 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-eb8f2dcb-cfdb-4229-a045-f93f2b7da023 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:05.376823 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-7b668345-89c7-439f-aa60-c854fa10c9ca tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:05.377803 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-7b668345-89c7-439f-aa60-c854fa10c9ca tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: eaab6bae-ac96-452b-9d70-dded946abf05] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:05.389975 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7b668345-89c7-439f-aa60-c854fa10c9ca tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:05.390640 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7b668345-89c7-439f-aa60-c854fa10c9ca tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:05.393082 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7b668345-89c7-439f-aa60-c854fa10c9ca tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:05.393697 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7b668345-89c7-439f-aa60-c854fa10c9ca tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:05.682492 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-eb8f2dcb-cfdb-4229-a045-f93f2b7da023 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:05.703274 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-eb8f2dcb-cfdb-4229-a045-f93f2b7da023 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:05.707025 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-eb8f2dcb-cfdb-4229-a045-f93f2b7da023 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:05.708609 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-eb8f2dcb-cfdb-4229-a045-f93f2b7da023 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1721 microversion: 2.20 time: 0.349153 Jun 24 10:06:05.720911 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 327/645] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:06:05 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1721 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:06:05.726676 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-63941aaa-e245-42e1-bbcc-4939123950c3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:05.727322 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-63941aaa-e245-42e1-bbcc-4939123950c3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:05.732529 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:06:05.739162 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-63941aaa-e245-42e1-bbcc-4939123950c3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:05.739162 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-63941aaa-e245-42e1-bbcc-4939123950c3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:05.748656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-63941aaa-e245-42e1-bbcc-4939123950c3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:05.748656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-63941aaa-e245-42e1-bbcc-4939123950c3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:05.763782 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-63941aaa-e245-42e1-bbcc-4939123950c3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] HTTP exception thrown: Instance 84bc600e-1c87-4ba3-9dfa-421ee774e45e could not be found. Jun 24 10:06:05.766909 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-63941aaa-e245-42e1-bbcc-4939123950c3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Request method failure captured: Jun 24 10:06:05.766909 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e HTTP/1.1 Jun 24 10:06:05.766909 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:06:05.766909 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:06:05.766909 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:06:05.766909 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 0 Jun 24 10:06:05.766909 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:06:05.766909 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:06:05.766909 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:06:05.766909 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:06:05.766909 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitYtksazN-0In_4Z9pNARGm41_SvfSYzVIiQMHJgKhqCbnebvahtLlP0-HneeOsfVxLqDg-MT5G7A-g6l_qhpaLGWizq3WI5bFsGLC5PGQ4JDM3GWIqNO5WqFaMxQyMPbuDVj7_PyhN0KR03YRoZjozC67hqTDUwI9GNtIMmAYgPPZBY Jun 24 10:06:05.766909 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:06:05.766909 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:06:05.766909 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:06:05.766909 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:06:05.766909 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:06:05.766909 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:06:05.766909 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: b57a965c8ac24ad383260d621813bc3b Jun 24 10:06:05.766909 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-AttachVolumeTestJSON-1075129304 Jun 24 10:06:05.766909 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:06:05.766909 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:06:05.769372 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b57a965c8ac24ad383260d621813bc3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b57a965c8ac24ad383260d621813bc3b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b57a965c8ac24ad383260d621813bc3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b57a965c8ac24ad383260d621813bc3b"}]}] Jun 24 10:06:05.769372 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-AttachVolumeTestJSON-1075129304 Jun 24 10:06:05.769372 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: b57a965c8ac24ad383260d621813bc3b Jun 24 10:06:05.769372 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1075129304 Jun 24 10:06:05.769372 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-AttachVolumeTestJSON-1075129304-project Jun 24 10:06:05.769372 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:06:05.769372 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:06:05.769372 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: b9d6654cd5c54c0294cbe1e2a1204c76 Jun 24 10:06:05.769372 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-AttachVolumeTestJSON-1075129304-project Jun 24 10:06:05.769372 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: > Jun 24 10:06:05.769372 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Instance 84bc600e-1c87-4ba3-9dfa-421ee774e45e could not be found. Jun 24 10:06:05.769372 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'id': '84bc600e-1c87-4ba3-9dfa-421ee774e45e'} Jun 24 10:06:05.776601 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:06:05.776601 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:06:05.776601 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:06:05.776601 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:06:05.776601 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:06:05.776601 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:06:05.776601 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:06:05.776601 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:06:05.776601 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:06:05.776601 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:06:05.776601 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84bc600e-1c87-4ba3-9dfa-421ee774e45e could not be found. Jun 24 10:06:05.776601 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:06:05.776601 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:06:05.776601 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:06:05.776601 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:06:05.776601 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:06:05.776601 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:06:05.776601 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:06:05.776601 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:06:05.776601 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:06:05.778434 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:06:05.778434 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:06:05.778434 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:06:05.778434 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:06:05.778434 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:06:05.778434 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:06:05.778434 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:06:05.778434 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84bc600e-1c87-4ba3-9dfa-421ee774e45e could not be found. Jun 24 10:06:05.778434 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:06:05.778434 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:06:05.778434 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:06:05.778434 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:06:05.778434 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:06:05.778434 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:06:05.778434 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:06:05.778434 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:06:05.778434 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84bc600e-1c87-4ba3-9dfa-421ee774e45e could not be found. Jun 24 10:06:05.778434 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:06:05.780005 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-63941aaa-e245-42e1-bbcc-4939123950c3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Returning 404 to user: Instance 84bc600e-1c87-4ba3-9dfa-421ee774e45e could not be found. {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:06:05.780005 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-63941aaa-e245-42e1-bbcc-4939123950c3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 404 len: 111 microversion: 2.1 time: 0.052533 Jun 24 10:06:05.780005 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 328/646] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:05 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:06:05.788560 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-4f742bd7-7283-47ac-84c1-40a75b6c1826 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '.version_select at 0x7f03099394c0>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:05.901967 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-4f742bd7-7283-47ac-84c1-40a75b6c1826 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-170224298" status: 202 len: 0 microversion: 2.1 time: 0.120914 Jun 24 10:06:05.902874 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 329/647] 10.222.0.26 () {58 vars in 1217 bytes} [Fri Jun 24 10:06:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-170224298 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:06:05.918531 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-7b668345-89c7-439f-aa60-c854fa10c9ca tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:05.931339 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-7b668345-89c7-439f-aa60-c854fa10c9ca tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05" status: 200 len: 1319 microversion: 2.1 time: 0.559187 Jun 24 10:06:05.944299 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 319/648] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:05 2022] GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05 => generated 1319 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:06.356925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-22b6951d-5a40-47d2-8847-2f2b5590ec17 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:06.358595 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-22b6951d-5a40-47d2-8847-2f2b5590ec17 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:06.367189 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-22b6951d-5a40-47d2-8847-2f2b5590ec17 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:06.368574 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-22b6951d-5a40-47d2-8847-2f2b5590ec17 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:06.369604 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-22b6951d-5a40-47d2-8847-2f2b5590ec17 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:06.370119 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-22b6951d-5a40-47d2-8847-2f2b5590ec17 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:06.592671 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-22b6951d-5a40-47d2-8847-2f2b5590ec17 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:06.606442 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-22b6951d-5a40-47d2-8847-2f2b5590ec17 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1688 microversion: 2.1 time: 0.255041 Jun 24 10:06:06.607303 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 330/649] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:06 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1688 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:06.728655 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-8b9af234-de47-4904-9fb7-569e190a392a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:06.729577 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-8b9af234-de47-4904-9fb7-569e190a392a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:06.732174 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell0:SELECT=2 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:06:06.734855 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell0:SELECT=6 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:06:06.742254 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8b9af234-de47-4904-9fb7-569e190a392a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:06.742834 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8b9af234-de47-4904-9fb7-569e190a392a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:06.743693 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8b9af234-de47-4904-9fb7-569e190a392a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:06.744298 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8b9af234-de47-4904-9fb7-569e190a392a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:06.953615 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-883434c7-a615-49f3-be34-3f1848946822 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:06.954662 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-883434c7-a615-49f3-be34-3f1848946822 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: eaab6bae-ac96-452b-9d70-dded946abf05] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:06.971094 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell0:SELECT=2 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:06:06.973115 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-883434c7-a615-49f3-be34-3f1848946822 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:06.973577 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-883434c7-a615-49f3-be34-3f1848946822 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:06.974432 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-883434c7-a615-49f3-be34-3f1848946822 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:06.975325 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-883434c7-a615-49f3-be34-3f1848946822 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:07.087487 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-8b9af234-de47-4904-9fb7-569e190a392a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:07.091240 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:06:07.114120 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-8b9af234-de47-4904-9fb7-569e190a392a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:07.114120 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-8b9af234-de47-4904-9fb7-569e190a392a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:07.114120 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-8b9af234-de47-4904-9fb7-569e190a392a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1654 microversion: 2.20 time: 0.383721 Jun 24 10:06:07.114404 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 320/650] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:06:06 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1654 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:06:07.119916 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-00e8b86e-ca5e-4141-9ada-ea3050f5431d req-d8c5ad59-fbe5-4af3-944b-00e3838dcf26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "904eb348-521e-499e-8127-cb3096230877", "name": "network-vif-deleted", "tag": "bc68c0d7-3cc3-4add-8d35-8b1892ac129e"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:06:07.141782 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-00e8b86e-ca5e-4141-9ada-ea3050f5431d req-d8c5ad59-fbe5-4af3-944b-00e3838dcf26 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:07.141782 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-00e8b86e-ca5e-4141-9ada-ea3050f5431d req-d8c5ad59-fbe5-4af3-944b-00e3838dcf26 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:07.159537 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-00e8b86e-ca5e-4141-9ada-ea3050f5431d req-d8c5ad59-fbe5-4af3-944b-00e3838dcf26 service nova] Creating event network-vif-deleted:bc68c0d7-3cc3-4add-8d35-8b1892ac129e for instance 904eb348-521e-499e-8127-cb3096230877 on hv-cinder-84327 Jun 24 10:06:07.181201 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-00e8b86e-ca5e-4141-9ada-ea3050f5431d req-d8c5ad59-fbe5-4af3-944b-00e3838dcf26 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071172 Jun 24 10:06:07.181816 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 321/651] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:06:07.196507 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-883434c7-a615-49f3-be34-3f1848946822 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:07.205398 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-883434c7-a615-49f3-be34-3f1848946822 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05" status: 200 len: 1319 microversion: 2.1 time: 0.257012 Jun 24 10:06:07.215900 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 331/652] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:06 2022] GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05 => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:06:07.625616 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-17ba6d5e-e695-4910-8caf-9a83d74c2554 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:07.632845 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-17ba6d5e-e695-4910-8caf-9a83d74c2554 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:07.642181 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-17ba6d5e-e695-4910-8caf-9a83d74c2554 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:07.642639 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-17ba6d5e-e695-4910-8caf-9a83d74c2554 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:07.643418 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-17ba6d5e-e695-4910-8caf-9a83d74c2554 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:07.643859 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-17ba6d5e-e695-4910-8caf-9a83d74c2554 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:07.740580 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-17ba6d5e-e695-4910-8caf-9a83d74c2554 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:07.749537 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-17ba6d5e-e695-4910-8caf-9a83d74c2554 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1620 microversion: 2.1 time: 0.128006 Jun 24 10:06:07.751072 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 322/653] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:07 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1620 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:08.089072 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-c413bbbe-0288-4ed0-9139-662f54079251 req-a222431c-3fc0-4135-8bbd-a93180215c54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c170d532-d8da-4b26-879d-22c7dc180716", "name": "network-vif-deleted", "tag": "62ac8ae2-de6d-4539-8e21-9a572eab33d9"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:06:08.102534 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-c413bbbe-0288-4ed0-9139-662f54079251 req-a222431c-3fc0-4135-8bbd-a93180215c54 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:08.108227 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-c413bbbe-0288-4ed0-9139-662f54079251 req-a222431c-3fc0-4135-8bbd-a93180215c54 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:08.137319 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-c413bbbe-0288-4ed0-9139-662f54079251 req-a222431c-3fc0-4135-8bbd-a93180215c54 service nova] Creating event network-vif-deleted:62ac8ae2-de6d-4539-8e21-9a572eab33d9 for instance c170d532-d8da-4b26-879d-22c7dc180716 on hv-cinder-84327 Jun 24 10:06:08.149149 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-c413bbbe-0288-4ed0-9139-662f54079251 req-a222431c-3fc0-4135-8bbd-a93180215c54 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064553 Jun 24 10:06:08.156328 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 323/654] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:06:08.234349 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-f6988e9e-0efe-4725-b963-3d2daa95425e tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Action: 'create', calling method: .version_select at 0x7f0309883d30>, body: {"keypair": {"name": "tempest-keypair-1173426337", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHlg2L6sozKUa6etSxFLHhoKWuJVBAtZ6gtl6QvEuN92t+VKeeHi4mohwwfe1aqnVaLoK3oJbMggQ7OxlmKBgzJyQPXvb1uz1WJGAsdnZ1ht5q8hhowzuMesAej2vAvfA=="}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:06:08.244299 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-f6988e9e-0efe-4725-b963-3d2daa95425e tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Getting quotas for project b57a965c8ac24ad383260d621813bc3b. Resources: {'key_pairs'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:06:08.248649 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-f6988e9e-0efe-4725-b963-3d2daa95425e tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Getting quotas for user b9d6654cd5c54c0294cbe1e2a1204c76 and project b57a965c8ac24ad383260d621813bc3b. Resources: {'key_pairs'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:06:08.298016 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-696dc2d5-fe11-4269-aa56-b1d3d433369b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:08.299065 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-696dc2d5-fe11-4269-aa56-b1d3d433369b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:08.306122 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-696dc2d5-fe11-4269-aa56-b1d3d433369b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:08.308688 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-696dc2d5-fe11-4269-aa56-b1d3d433369b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:08.309873 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-696dc2d5-fe11-4269-aa56-b1d3d433369b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:08.310538 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-696dc2d5-fe11-4269-aa56-b1d3d433369b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:08.340005 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:06:08.343634 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-696dc2d5-fe11-4269-aa56-b1d3d433369b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:08.344139 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-696dc2d5-fe11-4269-aa56-b1d3d433369b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:08.344599 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.objects.instance [None req-696dc2d5-fe11-4269-aa56-b1d3d433369b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lazy-loading 'fault' on Instance uuid 904eb348-521e-499e-8127-cb3096230877 {{(pid=124980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:06:08.357491 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-f6988e9e-0efe-4725-b963-3d2daa95425e tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.296669 Jun 24 10:06:08.362049 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 332/655] 10.222.0.26 () {60 vars in 1158 bytes} [Fri Jun 24 10:06:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:06:08.364503 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-4fdf5d1f-1357-49f5-949f-656e4956ecf7 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:08.365304 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-4fdf5d1f-1357-49f5-949f-656e4956ecf7 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: eaab6bae-ac96-452b-9d70-dded946abf05] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:08.373880 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4fdf5d1f-1357-49f5-949f-656e4956ecf7 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:08.374501 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4fdf5d1f-1357-49f5-949f-656e4956ecf7 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:08.376468 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4fdf5d1f-1357-49f5-949f-656e4956ecf7 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:08.377316 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4fdf5d1f-1357-49f5-949f-656e4956ecf7 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:08.395358 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-696dc2d5-fe11-4269-aa56-b1d3d433369b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:08.403791 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-696dc2d5-fe11-4269-aa56-b1d3d433369b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:08.405690 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-696dc2d5-fe11-4269-aa56-b1d3d433369b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:08.407158 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-696dc2d5-fe11-4269-aa56-b1d3d433369b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 200 len: 1370 microversion: 2.20 time: 0.248829 Jun 24 10:06:08.408229 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 324/656] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:06:08 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 1370 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:06:08.579699 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-4fdf5d1f-1357-49f5-949f-656e4956ecf7 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:08.590675 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-4fdf5d1f-1357-49f5-949f-656e4956ecf7 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05" status: 200 len: 1319 microversion: 2.1 time: 0.231178 Jun 24 10:06:08.591568 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 333/657] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:08 2022] GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:08.767135 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-7b398373-43cf-47c7-a4d2-b4a29db00c3d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:08.768493 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-7b398373-43cf-47c7-a4d2-b4a29db00c3d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:08.775833 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7b398373-43cf-47c7-a4d2-b4a29db00c3d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:08.776639 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7b398373-43cf-47c7-a4d2-b4a29db00c3d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:08.777704 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7b398373-43cf-47c7-a4d2-b4a29db00c3d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:08.778154 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7b398373-43cf-47c7-a4d2-b4a29db00c3d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:08.853508 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-7b398373-43cf-47c7-a4d2-b4a29db00c3d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:08.864376 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-7b398373-43cf-47c7-a4d2-b4a29db00c3d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1620 microversion: 2.1 time: 0.101331 Jun 24 10:06:08.865303 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 325/658] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:08 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1620 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:09.428847 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-0e95b363-9527-421b-ae40-aaf1e47e9ada tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:09.429467 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-0e95b363-9527-421b-ae40-aaf1e47e9ada tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:09.436628 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0e95b363-9527-421b-ae40-aaf1e47e9ada tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:09.437083 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0e95b363-9527-421b-ae40-aaf1e47e9ada tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:09.438634 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0e95b363-9527-421b-ae40-aaf1e47e9ada tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:09.439078 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0e95b363-9527-421b-ae40-aaf1e47e9ada tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:09.455465 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-0e95b363-9527-421b-ae40-aaf1e47e9ada tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] HTTP exception thrown: Instance 904eb348-521e-499e-8127-cb3096230877 could not be found. Jun 24 10:06:09.457081 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-0e95b363-9527-421b-ae40-aaf1e47e9ada tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Request method failure captured: Jun 24 10:06:09.457081 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 HTTP/1.1 Jun 24 10:06:09.457081 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:06:09.457081 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:06:09.457081 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:06:09.457081 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 0 Jun 24 10:06:09.457081 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:06:09.457081 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:06:09.457081 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:06:09.457081 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:06:09.457081 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitYtjkJw2bHOeZ2cDcfFEKgEvHgE9PcrydC3_0C2_vVDx3RS9Ijzx0RavfKpEzUfBr0snAkOZjXp0ZofsjOoJtHAlurMx_T47sNxT9CHDHEqfOmPfxhcpA_rDpqhSmEtyZVp1ZLcMt9dR4aAJniy9HaUfNPmh-rWZXp0XoJQb88TeRxk Jun 24 10:06:09.457081 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:06:09.457081 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:06:09.457081 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:06:09.457081 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:06:09.457081 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 10:06:09.457081 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:06:09.457081 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:06:09.457081 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: a77797eae68a42639f886f64db5f5598 Jun 24 10:06:09.457081 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1169333461 Jun 24 10:06:09.457081 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:06:09.457081 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:06:09.458514 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a77797eae68a42639f886f64db5f5598"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a77797eae68a42639f886f64db5f5598", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a77797eae68a42639f886f64db5f5598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a77797eae68a42639f886f64db5f5598"}]}] Jun 24 10:06:09.458514 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1169333461 Jun 24 10:06:09.458514 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: a77797eae68a42639f886f64db5f5598 Jun 24 10:06:09.458514 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1169333461 Jun 24 10:06:09.458514 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-AttachVolumeShelveTestJSON-1169333461-project Jun 24 10:06:09.458514 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:06:09.458514 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:06:09.458514 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: cd894c323c604ed593a01d17092e6c2a Jun 24 10:06:09.458514 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1169333461-project Jun 24 10:06:09.458514 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: > Jun 24 10:06:09.458514 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Instance 904eb348-521e-499e-8127-cb3096230877 could not be found. Jun 24 10:06:09.458514 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'id': '904eb348-521e-499e-8127-cb3096230877'} Jun 24 10:06:09.459296 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:06:09.459296 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:06:09.459296 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:06:09.459296 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:06:09.459296 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:06:09.459296 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:06:09.459296 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:06:09.459296 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:06:09.459296 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:06:09.459296 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:06:09.459296 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 904eb348-521e-499e-8127-cb3096230877 could not be found. Jun 24 10:06:09.459296 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:06:09.459296 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:06:09.459296 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:06:09.459296 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:06:09.459296 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:06:09.459296 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:06:09.459296 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:06:09.459296 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:06:09.459296 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:06:09.460946 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:06:09.460946 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:06:09.460946 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:06:09.460946 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:06:09.460946 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:06:09.460946 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:06:09.460946 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:06:09.460946 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 904eb348-521e-499e-8127-cb3096230877 could not be found. Jun 24 10:06:09.460946 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:06:09.460946 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:06:09.460946 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:06:09.460946 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:06:09.460946 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:06:09.460946 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:06:09.460946 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:06:09.460946 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:06:09.460946 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 904eb348-521e-499e-8127-cb3096230877 could not be found. Jun 24 10:06:09.460946 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:06:09.462243 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-0e95b363-9527-421b-ae40-aaf1e47e9ada tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Returning 404 to user: Instance 904eb348-521e-499e-8127-cb3096230877 could not be found. {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:06:09.462243 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-0e95b363-9527-421b-ae40-aaf1e47e9ada tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 404 len: 111 microversion: 2.20 time: 0.033578 Jun 24 10:06:09.462243 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 334/659] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:06:09 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 10:06:09.470590 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-4a1fd54b-0cba-4270-80e9-1f99ec9f975c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '.version_select at 0x7f0309a04dc0>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:09.545077 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-4a1fd54b-0cba-4270-80e9-1f99ec9f975c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-541898312" status: 204 len: 0 microversion: 2.20 time: 0.081222 Jun 24 10:06:09.545702 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 326/660] 10.222.0.26 () {60 vars in 1258 bytes} [Fri Jun 24 10:06:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-541898312 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 10:06:09.608208 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-e9a3d5c0-81e5-4883-8f5d-3d2ca2df78ab tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:09.608859 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-e9a3d5c0-81e5-4883-8f5d-3d2ca2df78ab tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: eaab6bae-ac96-452b-9d70-dded946abf05] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:09.616194 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e9a3d5c0-81e5-4883-8f5d-3d2ca2df78ab tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:09.616648 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e9a3d5c0-81e5-4883-8f5d-3d2ca2df78ab tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:09.617413 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e9a3d5c0-81e5-4883-8f5d-3d2ca2df78ab tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:09.617847 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e9a3d5c0-81e5-4883-8f5d-3d2ca2df78ab tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:09.845200 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-e9a3d5c0-81e5-4883-8f5d-3d2ca2df78ab tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:09.853097 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-e9a3d5c0-81e5-4883-8f5d-3d2ca2df78ab tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05" status: 200 len: 1319 microversion: 2.1 time: 0.248884 Jun 24 10:06:09.853672 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 335/661] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:09 2022] GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05 => generated 1319 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:09.882636 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-7c8ba31b-2cac-4196-bf14-b824a58f91c1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:09.883484 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-7c8ba31b-2cac-4196-bf14-b824a58f91c1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:09.891250 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7c8ba31b-2cac-4196-bf14-b824a58f91c1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:09.891816 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7c8ba31b-2cac-4196-bf14-b824a58f91c1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:09.892706 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7c8ba31b-2cac-4196-bf14-b824a58f91c1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:09.893390 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7c8ba31b-2cac-4196-bf14-b824a58f91c1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:09.945197 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7c8ba31b-2cac-4196-bf14-b824a58f91c1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:09.945974 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7c8ba31b-2cac-4196-bf14-b824a58f91c1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:09.946438 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.objects.instance [None req-7c8ba31b-2cac-4196-bf14-b824a58f91c1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lazy-loading 'fault' on Instance uuid c170d532-d8da-4b26-879d-22c7dc180716 {{(pid=124980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:06:10.019155 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-7c8ba31b-2cac-4196-bf14-b824a58f91c1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:10.028143 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-7c8ba31b-2cac-4196-bf14-b824a58f91c1 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 200 len: 1335 microversion: 2.1 time: 0.150057 Jun 24 10:06:10.038224 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 327/662] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:09 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 1335 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:10.428775 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-5e360c75-c154-49d1-9a34-4536eb5ff918 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Action: 'create', calling method: .version_select at 0x7f030994bf70>, body: {"keypair": {"name": "tempest-keypair-1539427661", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYevx86pEauGUTNdiY+2rX8mcY6UfLXLLZXYzGAymUje0PmSizb/oFq5b1lTjKTg6OMxTvFiXm/UGcJb095ulu/iPR0Dj5/Tvh0lzCW4Wv76pasf1z83OZ5iwvHKuD+dQ=="}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:06:10.444194 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-5e360c75-c154-49d1-9a34-4536eb5ff918 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Getting quotas for project a77797eae68a42639f886f64db5f5598. Resources: {'key_pairs'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:06:10.447939 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-5e360c75-c154-49d1-9a34-4536eb5ff918 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Getting quotas for user cd894c323c604ed593a01d17092e6c2a and project a77797eae68a42639f886f64db5f5598. Resources: {'key_pairs'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:06:10.555719 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-5e360c75-c154-49d1-9a34-4536eb5ff918 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.130869 Jun 24 10:06:10.556389 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 336/663] 10.222.0.26 () {62 vars in 1199 bytes} [Fri Jun 24 10:06:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 132 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 24 10:06:10.837280 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-4712244c-2f1c-4ee3-b047-1799ba7b06d3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1436690840", "imageRef": "f6b1dddb-2953-41a2-99e3-00aeca441bd9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c8f19ac-e8c2-4044-a226-361510084949"}], "security_groups": [{"name": "tempest-securitygroup--302669121"}], "key_name": "tempest-keypair-1173426337", "user_data": "}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:06:10.869941 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-0c3e7d69-2068-4392-a6de-e242bd313290 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:10.870561 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-0c3e7d69-2068-4392-a6de-e242bd313290 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: eaab6bae-ac96-452b-9d70-dded946abf05] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:10.877996 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0c3e7d69-2068-4392-a6de-e242bd313290 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:10.878880 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0c3e7d69-2068-4392-a6de-e242bd313290 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:10.879212 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0c3e7d69-2068-4392-a6de-e242bd313290 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:10.879651 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0c3e7d69-2068-4392-a6de-e242bd313290 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:10.969915 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.network.neutron [None req-4712244c-2f1c-4ee3-b047-1799ba7b06d3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] validate_networks() for [('3c8f19ac-e8c2-4044-a226-361510084949', None, None, None, None, None)] {{(pid=124980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:06:11.023939 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-0c3e7d69-2068-4392-a6de-e242bd313290 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:11.032615 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-0c3e7d69-2068-4392-a6de-e242bd313290 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05" status: 200 len: 1319 microversion: 2.1 time: 0.166453 Jun 24 10:06:11.033190 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 337/664] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:10 2022] GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:06:11.049323 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-94c626f2-e6c1-41d9-b4c6-be8895e3fdc6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:11.049975 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-94c626f2-e6c1-41d9-b4c6-be8895e3fdc6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: c170d532-d8da-4b26-879d-22c7dc180716] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:11.056182 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-94c626f2-e6c1-41d9-b4c6-be8895e3fdc6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:11.056640 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-94c626f2-e6c1-41d9-b4c6-be8895e3fdc6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:11.057823 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-94c626f2-e6c1-41d9-b4c6-be8895e3fdc6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:11.058474 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-94c626f2-e6c1-41d9-b4c6-be8895e3fdc6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:11.073965 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-94c626f2-e6c1-41d9-b4c6-be8895e3fdc6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] HTTP exception thrown: Instance c170d532-d8da-4b26-879d-22c7dc180716 could not be found. Jun 24 10:06:11.075865 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-94c626f2-e6c1-41d9-b4c6-be8895e3fdc6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Request method failure captured: Jun 24 10:06:11.075865 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 HTTP/1.1 Jun 24 10:06:11.075865 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:06:11.075865 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:06:11.075865 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:06:11.075865 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 0 Jun 24 10:06:11.075865 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:06:11.075865 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:06:11.075865 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:06:11.075865 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:06:11.075865 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitYtobSN6CjiACUjTyXEql4xKzLsglXk-l3YaDQLAZo4vs-RgMAM3IADpJhPypTRBSlCExLMR--YbzFicmjbwkbj-OJB_zzYsnZ_Gbqq5n_CnUB_ypRKgSN3BcXHuMsmCBlnf0I3kK4SJFeqnT6AupdpkZsj57O8A_owmEagvxq33osI Jun 24 10:06:11.075865 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:06:11.075865 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:06:11.075865 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:06:11.075865 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:06:11.075865 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:06:11.075865 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:06:11.075865 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: ddf89eff2d584c508a967f1686090be1 Jun 24 10:06:11.075865 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1125620466 Jun 24 10:06:11.075865 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:06:11.075865 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:06:11.077486 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ddf89eff2d584c508a967f1686090be1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ddf89eff2d584c508a967f1686090be1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ddf89eff2d584c508a967f1686090be1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ddf89eff2d584c508a967f1686090be1"}]}] Jun 24 10:06:11.077486 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1125620466 Jun 24 10:06:11.077486 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: ddf89eff2d584c508a967f1686090be1 Jun 24 10:06:11.077486 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1125620466 Jun 24 10:06:11.077486 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-ServerRescueNegativeTestJSON-1125620466-project Jun 24 10:06:11.077486 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:06:11.077486 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:06:11.077486 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: b03913e742104648977aa5d61347f38e Jun 24 10:06:11.077486 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1125620466-project Jun 24 10:06:11.077486 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: > Jun 24 10:06:11.077486 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Instance c170d532-d8da-4b26-879d-22c7dc180716 could not be found. Jun 24 10:06:11.077486 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'id': 'c170d532-d8da-4b26-879d-22c7dc180716'} Jun 24 10:06:11.078370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:06:11.078370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:06:11.078370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:06:11.078370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:06:11.078370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:06:11.078370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:06:11.078370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:06:11.078370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:06:11.078370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:06:11.078370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:06:11.078370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c170d532-d8da-4b26-879d-22c7dc180716 could not be found. Jun 24 10:06:11.078370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:06:11.078370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:06:11.078370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:06:11.078370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:06:11.078370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:06:11.078370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:06:11.078370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:06:11.078370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:06:11.078370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:06:11.079656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:06:11.079656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:06:11.079656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:06:11.079656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:06:11.079656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:06:11.079656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:06:11.079656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:06:11.079656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c170d532-d8da-4b26-879d-22c7dc180716 could not be found. Jun 24 10:06:11.079656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:06:11.079656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:06:11.079656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:06:11.079656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:06:11.079656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:06:11.079656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:06:11.079656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:06:11.079656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:06:11.079656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c170d532-d8da-4b26-879d-22c7dc180716 could not be found. Jun 24 10:06:11.079656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:06:11.082480 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-94c626f2-e6c1-41d9-b4c6-be8895e3fdc6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Returning 404 to user: Instance c170d532-d8da-4b26-879d-22c7dc180716 could not be found. {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:06:11.082480 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-94c626f2-e6c1-41d9-b4c6-be8895e3fdc6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716" status: 404 len: 111 microversion: 2.1 time: 0.033458 Jun 24 10:06:11.082480 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 338/665] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:11 2022] GET /compute/v2.1/servers/c170d532-d8da-4b26-879d-22c7dc180716 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:06:11.086750 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-23d0772e-97e8-4e8f-beab-d05d425d602d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '.version_select at 0x7f0309883790>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:11.197508 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-23d0772e-97e8-4e8f-beab-d05d425d602d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-291821548" status: 202 len: 0 microversion: 2.1 time: 0.115146 Jun 24 10:06:11.206386 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 339/666] 10.222.0.26 () {58 vars in 1217 bytes} [Fri Jun 24 10:06:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-291821548 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 10:06:11.513450 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-4712244c-2f1c-4ee3-b047-1799ba7b06d3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Flavor limits 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:06:11.513925 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-4712244c-2f1c-4ee3-b047-1799ba7b06d3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Image limits 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:06:11.514418 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-4712244c-2f1c-4ee3-b047-1799ba7b06d3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Flavor pref 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:06:11.514827 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-4712244c-2f1c-4ee3-b047-1799ba7b06d3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Image pref 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:06:11.515230 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-4712244c-2f1c-4ee3-b047-1799ba7b06d3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:06:11.524309 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4712244c-2f1c-4ee3-b047-1799ba7b06d3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:11.524749 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4712244c-2f1c-4ee3-b047-1799ba7b06d3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:11.530927 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4712244c-2f1c-4ee3-b047-1799ba7b06d3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:11.530927 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4712244c-2f1c-4ee3-b047-1799ba7b06d3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:11.542223 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-4712244c-2f1c-4ee3-b047-1799ba7b06d3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Getting quotas for project b57a965c8ac24ad383260d621813bc3b. Resources: {'instances', 'cores', 'ram'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:06:11.546489 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-4712244c-2f1c-4ee3-b047-1799ba7b06d3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Getting quotas for user b9d6654cd5c54c0294cbe1e2a1204c76 and project b57a965c8ac24ad383260d621813bc3b. Resources: {'instances', 'cores', 'ram'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:06:11.558053 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-4712244c-2f1c-4ee3-b047-1799ba7b06d3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Going to run 1 instances... {{(pid=124980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:06:11.560438 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-4712244c-2f1c-4ee3-b047-1799ba7b06d3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6b1dddb-2953-41a2-99e3-00aeca441bd9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:06:11.707312 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-4712244c-2f1c-4ee3-b047-1799ba7b06d3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.874660 Jun 24 10:06:11.707978 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 328/667] 10.222.0.26 () {60 vars in 1146 bytes} [Fri Jun 24 10:06:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:06:11.720015 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-725ad767-84f2-40b9-b926-9f9db386efa0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:11.721108 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-725ad767-84f2-40b9-b926-9f9db386efa0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:11.794790 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-725ad767-84f2-40b9-b926-9f9db386efa0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:11.807097 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-725ad767-84f2-40b9-b926-9f9db386efa0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022" status: 200 len: 1238 microversion: 2.1 time: 0.092284 Jun 24 10:06:11.808778 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 340/668] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:11 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022 => generated 1238 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:12.055776 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-b9e19c97-e062-4a04-9c9e-1bc01cf1d844 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:12.056644 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-b9e19c97-e062-4a04-9c9e-1bc01cf1d844 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: eaab6bae-ac96-452b-9d70-dded946abf05] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:12.063671 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b9e19c97-e062-4a04-9c9e-1bc01cf1d844 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:12.063900 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b9e19c97-e062-4a04-9c9e-1bc01cf1d844 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:12.064672 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b9e19c97-e062-4a04-9c9e-1bc01cf1d844 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:12.065116 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b9e19c97-e062-4a04-9c9e-1bc01cf1d844 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:12.285900 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-b9e19c97-e062-4a04-9c9e-1bc01cf1d844 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:12.295641 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-b9e19c97-e062-4a04-9c9e-1bc01cf1d844 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05" status: 200 len: 1319 microversion: 2.1 time: 0.242760 Jun 24 10:06:12.306043 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 329/669] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:12 2022] GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:12.831828 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-c4ba0875-5613-4eab-a23a-2c52757795a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:12.831828 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-c4ba0875-5613-4eab-a23a-2c52757795a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:12.832889 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c4ba0875-5613-4eab-a23a-2c52757795a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:12.832889 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c4ba0875-5613-4eab-a23a-2c52757795a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:12.833689 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c4ba0875-5613-4eab-a23a-2c52757795a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:12.833689 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c4ba0875-5613-4eab-a23a-2c52757795a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:12.901552 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-c4ba0875-5613-4eab-a23a-2c52757795a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:12.909589 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-c4ba0875-5613-4eab-a23a-2c52757795a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022" status: 200 len: 1242 microversion: 2.1 time: 0.089739 Jun 24 10:06:12.910153 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 341/670] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:12 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022 => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:13.170761 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-a6b641c2-b85e-4c47-a77d-6d287d4a9dee req-12ac66b0-f226-40ff-a9f4-ba72c038ab6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaab6bae-ac96-452b-9d70-dded946abf05", "name": "network-vif-plugged", "status": "completed", "tag": "09666df1-84b4-415c-9fc9-228adfcfdef3"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:06:13.180891 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-a6b641c2-b85e-4c47-a77d-6d287d4a9dee req-12ac66b0-f226-40ff-a9f4-ba72c038ab6d service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:13.181437 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-a6b641c2-b85e-4c47-a77d-6d287d4a9dee req-12ac66b0-f226-40ff-a9f4-ba72c038ab6d service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:13.197966 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-a6b641c2-b85e-4c47-a77d-6d287d4a9dee req-12ac66b0-f226-40ff-a9f4-ba72c038ab6d service nova] Creating event network-vif-plugged:09666df1-84b4-415c-9fc9-228adfcfdef3 for instance eaab6bae-ac96-452b-9d70-dded946abf05 on hv-cinder-84327 Jun 24 10:06:13.202027 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-673fbc25-58ca-4bd7-8586-5a61302fb929 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-726790035", "imageRef": "f6b1dddb-2953-41a2-99e3-00aeca441bd9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "acbbe71d-fc88-4521-a985-304e44d1216d"}], "security_groups": [{"name": "tempest-securitygroup--2061219001"}], "key_name": "tempest-keypair-1539427661", "user_data": "}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:06:13.207023 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-a6b641c2-b85e-4c47-a77d-6d287d4a9dee req-12ac66b0-f226-40ff-a9f4-ba72c038ab6d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036136 Jun 24 10:06:13.207023 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 330/671] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:06:13.314354 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-d6f7762f-e4b6-49b9-926e-052b6e3a29cb tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:13.324251 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-d6f7762f-e4b6-49b9-926e-052b6e3a29cb tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: eaab6bae-ac96-452b-9d70-dded946abf05] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:13.325517 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.network.neutron [None req-673fbc25-58ca-4bd7-8586-5a61302fb929 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] validate_networks() for [('acbbe71d-fc88-4521-a985-304e44d1216d', None, None, None, None, None)] {{(pid=124979) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:06:13.332283 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d6f7762f-e4b6-49b9-926e-052b6e3a29cb tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:13.332745 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d6f7762f-e4b6-49b9-926e-052b6e3a29cb tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:13.333534 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d6f7762f-e4b6-49b9-926e-052b6e3a29cb tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:13.333978 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d6f7762f-e4b6-49b9-926e-052b6e3a29cb tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:13.487492 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d6f7762f-e4b6-49b9-926e-052b6e3a29cb tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:13.495147 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-d6f7762f-e4b6-49b9-926e-052b6e3a29cb tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05" status: 200 len: 1319 microversion: 2.1 time: 0.185410 Jun 24 10:06:13.495685 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 331/672] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:13 2022] GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:06:13.719294 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-673fbc25-58ca-4bd7-8586-5a61302fb929 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Flavor limits 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:06:13.719910 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-673fbc25-58ca-4bd7-8586-5a61302fb929 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Image limits 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:06:13.720417 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-673fbc25-58ca-4bd7-8586-5a61302fb929 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Flavor pref 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:06:13.720823 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-673fbc25-58ca-4bd7-8586-5a61302fb929 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Image pref 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:06:13.721227 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-673fbc25-58ca-4bd7-8586-5a61302fb929 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:06:13.730932 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-673fbc25-58ca-4bd7-8586-5a61302fb929 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:13.731374 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-673fbc25-58ca-4bd7-8586-5a61302fb929 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:13.732214 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-673fbc25-58ca-4bd7-8586-5a61302fb929 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:13.732651 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-673fbc25-58ca-4bd7-8586-5a61302fb929 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:13.739715 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=100 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:06:13.750889 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-673fbc25-58ca-4bd7-8586-5a61302fb929 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Getting quotas for project a77797eae68a42639f886f64db5f5598. Resources: {'instances', 'cores', 'ram'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:06:13.754828 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-673fbc25-58ca-4bd7-8586-5a61302fb929 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Getting quotas for user cd894c323c604ed593a01d17092e6c2a and project a77797eae68a42639f886f64db5f5598. Resources: {'instances', 'cores', 'ram'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:06:13.766392 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-673fbc25-58ca-4bd7-8586-5a61302fb929 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Going to run 1 instances... {{(pid=124979) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:06:13.768900 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-673fbc25-58ca-4bd7-8586-5a61302fb929 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6b1dddb-2953-41a2-99e3-00aeca441bd9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124979) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:06:13.929728 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-5338561a-890b-4fed-afbc-1cf4c85166da tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:13.930242 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-5338561a-890b-4fed-afbc-1cf4c85166da tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:13.936568 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5338561a-890b-4fed-afbc-1cf4c85166da tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:13.937008 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5338561a-890b-4fed-afbc-1cf4c85166da tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:13.938432 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5338561a-890b-4fed-afbc-1cf4c85166da tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:13.938863 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5338561a-890b-4fed-afbc-1cf4c85166da tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:13.972403 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-673fbc25-58ca-4bd7-8586-5a61302fb929 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.774749 Jun 24 10:06:13.973044 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 342/673] 10.222.0.26 () {62 vars in 1187 bytes} [Fri Jun 24 10:06:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 24 10:06:13.983431 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-df9b13e1-69ba-48dc-8da2-26a6f8b03f75 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:13.984170 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-df9b13e1-69ba-48dc-8da2-26a6f8b03f75 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:14.003366 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-5338561a-890b-4fed-afbc-1cf4c85166da tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:14.011052 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-5338561a-890b-4fed-afbc-1cf4c85166da tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022" status: 200 len: 1290 microversion: 2.1 time: 0.088872 Jun 24 10:06:14.011787 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 332/674] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:13 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022 => generated 1290 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:06:14.063190 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-df9b13e1-69ba-48dc-8da2-26a6f8b03f75 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:14.072668 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-df9b13e1-69ba-48dc-8da2-26a6f8b03f75 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:14.074230 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-df9b13e1-69ba-48dc-8da2-26a6f8b03f75 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:14.075517 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-df9b13e1-69ba-48dc-8da2-26a6f8b03f75 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1281 microversion: 2.20 time: 0.096377 Jun 24 10:06:14.076071 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 343/675] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:06:13 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1281 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:06:14.512693 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-605ea1ce-8891-4d5b-935b-6c8108885865 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:14.513301 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-605ea1ce-8891-4d5b-935b-6c8108885865 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: eaab6bae-ac96-452b-9d70-dded946abf05] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:14.519826 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-605ea1ce-8891-4d5b-935b-6c8108885865 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:14.520317 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-605ea1ce-8891-4d5b-935b-6c8108885865 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:14.521088 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-605ea1ce-8891-4d5b-935b-6c8108885865 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:14.521529 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-605ea1ce-8891-4d5b-935b-6c8108885865 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:14.658614 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-605ea1ce-8891-4d5b-935b-6c8108885865 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:14.666086 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-605ea1ce-8891-4d5b-935b-6c8108885865 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05" status: 200 len: 1319 microversion: 2.1 time: 0.157281 Jun 24 10:06:14.666652 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 333/676] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:14 2022] GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:15.028384 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-6d1bcd61-a6c4-45a5-a2d5-524358807500 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:15.028993 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-6d1bcd61-a6c4-45a5-a2d5-524358807500 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:15.036291 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6d1bcd61-a6c4-45a5-a2d5-524358807500 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:15.036748 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6d1bcd61-a6c4-45a5-a2d5-524358807500 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:15.037585 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6d1bcd61-a6c4-45a5-a2d5-524358807500 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:15.038012 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6d1bcd61-a6c4-45a5-a2d5-524358807500 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:15.093262 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-2d72bbbf-c076-4517-b62d-9d905b5538a2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:15.093985 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-2d72bbbf-c076-4517-b62d-9d905b5538a2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:15.105046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2d72bbbf-c076-4517-b62d-9d905b5538a2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:15.105594 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2d72bbbf-c076-4517-b62d-9d905b5538a2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:15.106382 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2d72bbbf-c076-4517-b62d-9d905b5538a2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:15.106829 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2d72bbbf-c076-4517-b62d-9d905b5538a2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:15.107115 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-6d1bcd61-a6c4-45a5-a2d5-524358807500 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:15.114915 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-6d1bcd61-a6c4-45a5-a2d5-524358807500 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022" status: 200 len: 1298 microversion: 2.1 time: 0.090764 Jun 24 10:06:15.118597 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 344/677] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:15 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022 => generated 1298 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:15.120086 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-012f577a-4825-4da4-819b-02e98ee0a6f8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:15.120599 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-012f577a-4825-4da4-819b-02e98ee0a6f8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:15.131262 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-012f577a-4825-4da4-819b-02e98ee0a6f8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:15.131714 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-012f577a-4825-4da4-819b-02e98ee0a6f8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:15.132528 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-012f577a-4825-4da4-819b-02e98ee0a6f8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:15.132993 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-012f577a-4825-4da4-819b-02e98ee0a6f8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:15.161771 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-012f577a-4825-4da4-819b-02e98ee0a6f8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Going to try to terminate instance {{(pid=124979) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:06:15.172233 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2d72bbbf-c076-4517-b62d-9d905b5538a2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:15.181133 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2d72bbbf-c076-4517-b62d-9d905b5538a2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:15.182783 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2d72bbbf-c076-4517-b62d-9d905b5538a2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:15.183889 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-2d72bbbf-c076-4517-b62d-9d905b5538a2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1285 microversion: 2.20 time: 0.094511 Jun 24 10:06:15.184538 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 334/678] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:06:15 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:06:15.556416 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-012f577a-4825-4da4-819b-02e98ee0a6f8 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 204 len: 0 microversion: 2.1 time: 0.439646 Jun 24 10:06:15.560581 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 345/679] 10.222.0.26 () {58 vars in 1238 bytes} [Fri Jun 24 10:06:15 2022] DELETE /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:06:15.568039 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-11dfac54-b863-4cb7-a894-b881236366ec tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:15.568776 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-11dfac54-b863-4cb7-a894-b881236366ec tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:15.575717 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-11dfac54-b863-4cb7-a894-b881236366ec tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:15.576342 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-11dfac54-b863-4cb7-a894-b881236366ec tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:15.577191 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-11dfac54-b863-4cb7-a894-b881236366ec tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:15.577701 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-11dfac54-b863-4cb7-a894-b881236366ec tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:15.684636 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-834d9873-aa4f-4531-be88-b120fb9c8dcf tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:15.685335 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-834d9873-aa4f-4531-be88-b120fb9c8dcf tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: eaab6bae-ac96-452b-9d70-dded946abf05] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:15.692348 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-834d9873-aa4f-4531-be88-b120fb9c8dcf tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:15.692803 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-834d9873-aa4f-4531-be88-b120fb9c8dcf tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:15.693568 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-834d9873-aa4f-4531-be88-b120fb9c8dcf tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:15.694002 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-834d9873-aa4f-4531-be88-b120fb9c8dcf tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:15.723762 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-11dfac54-b863-4cb7-a894-b881236366ec tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:15.733062 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-11dfac54-b863-4cb7-a894-b881236366ec tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1507 microversion: 2.1 time: 0.170956 Jun 24 10:06:15.733899 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 335/680] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:15 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:15.836687 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-834d9873-aa4f-4531-be88-b120fb9c8dcf tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:15.844937 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-834d9873-aa4f-4531-be88-b120fb9c8dcf tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05" status: 200 len: 1509 microversion: 2.1 time: 0.164553 Jun 24 10:06:15.849589 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 346/681] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:15 2022] GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:06:15.862465 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-32437508-6496-4186-b3ce-4a4d90e7ef04 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5cbbaa28-3604-4820-b394-fb7c2e2bf060", "device": "/dev/sdb"}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:06:15.863657 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-32437508-6496-4186-b3ce-4a4d90e7ef04 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: eaab6bae-ac96-452b-9d70-dded946abf05] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:15.869882 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-32437508-6496-4186-b3ce-4a4d90e7ef04 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:15.870331 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-32437508-6496-4186-b3ce-4a4d90e7ef04 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:15.871102 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-32437508-6496-4186-b3ce-4a4d90e7ef04 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:15.871676 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-32437508-6496-4186-b3ce-4a4d90e7ef04 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:16.133617 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-ae886bc1-8f1f-4688-98c7-df50dbc8f01c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:16.134232 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-ae886bc1-8f1f-4688-98c7-df50dbc8f01c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:16.140834 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ae886bc1-8f1f-4688-98c7-df50dbc8f01c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:16.141306 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ae886bc1-8f1f-4688-98c7-df50dbc8f01c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:16.142074 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ae886bc1-8f1f-4688-98c7-df50dbc8f01c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:16.142499 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ae886bc1-8f1f-4688-98c7-df50dbc8f01c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:16.293938 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-ae886bc1-8f1f-4688-98c7-df50dbc8f01c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:16.302488 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-ae886bc1-8f1f-4688-98c7-df50dbc8f01c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022" status: 200 len: 1363 microversion: 2.1 time: 0.172792 Jun 24 10:06:16.303074 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 347/682] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:16 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:06:16.308043 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-ea354903-01a6-4449-8f4b-fbdf89e4a352 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:16.308692 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-ea354903-01a6-4449-8f4b-fbdf89e4a352 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:16.319598 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ea354903-01a6-4449-8f4b-fbdf89e4a352 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:16.320046 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ea354903-01a6-4449-8f4b-fbdf89e4a352 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:16.320849 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ea354903-01a6-4449-8f4b-fbdf89e4a352 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:16.321281 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ea354903-01a6-4449-8f4b-fbdf89e4a352 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:16.384652 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-ea354903-01a6-4449-8f4b-fbdf89e4a352 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:16.394314 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-ea354903-01a6-4449-8f4b-fbdf89e4a352 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:16.395799 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-ea354903-01a6-4449-8f4b-fbdf89e4a352 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:16.400320 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-ea354903-01a6-4449-8f4b-fbdf89e4a352 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1277 microversion: 2.20 time: 0.092940 Jun 24 10:06:16.400320 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 348/683] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:06:16 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1277 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:06:16.750445 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-e065e5ad-20a8-49e5-a847-97aa27693db0 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:16.751712 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-e065e5ad-20a8-49e5-a847-97aa27693db0 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:16.758164 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e065e5ad-20a8-49e5-a847-97aa27693db0 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:16.758597 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e065e5ad-20a8-49e5-a847-97aa27693db0 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:16.759350 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e065e5ad-20a8-49e5-a847-97aa27693db0 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:16.759780 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e065e5ad-20a8-49e5-a847-97aa27693db0 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:16.889585 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-e065e5ad-20a8-49e5-a847-97aa27693db0 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:16.897149 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-e065e5ad-20a8-49e5-a847-97aa27693db0 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1507 microversion: 2.1 time: 0.150645 Jun 24 10:06:16.897706 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 349/684] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:16 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:06:17.319828 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-1d7fc9bc-fb64-47fb-b85c-cbc9852fe2a7 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:17.320882 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-1d7fc9bc-fb64-47fb-b85c-cbc9852fe2a7 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:17.327076 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1d7fc9bc-fb64-47fb-b85c-cbc9852fe2a7 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:17.327521 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1d7fc9bc-fb64-47fb-b85c-cbc9852fe2a7 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:17.328304 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1d7fc9bc-fb64-47fb-b85c-cbc9852fe2a7 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:17.329231 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1d7fc9bc-fb64-47fb-b85c-cbc9852fe2a7 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:17.462951 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-1d7fc9bc-fb64-47fb-b85c-cbc9852fe2a7 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:17.469231 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-1d7fc9bc-fb64-47fb-b85c-cbc9852fe2a7 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022" status: 200 len: 1363 microversion: 2.1 time: 0.153238 Jun 24 10:06:17.469791 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 350/685] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:17 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:06:17.474823 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-47b325e7-312d-4274-80f9-2b680c5e6c0b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:17.475551 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-47b325e7-312d-4274-80f9-2b680c5e6c0b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:17.481286 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-47b325e7-312d-4274-80f9-2b680c5e6c0b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:17.481732 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-47b325e7-312d-4274-80f9-2b680c5e6c0b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:17.482483 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-47b325e7-312d-4274-80f9-2b680c5e6c0b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:17.482912 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-47b325e7-312d-4274-80f9-2b680c5e6c0b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:17.544572 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-47b325e7-312d-4274-80f9-2b680c5e6c0b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:17.552738 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-47b325e7-312d-4274-80f9-2b680c5e6c0b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:17.554270 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-47b325e7-312d-4274-80f9-2b680c5e6c0b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:17.555366 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-47b325e7-312d-4274-80f9-2b680c5e6c0b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1277 microversion: 2.20 time: 0.084080 Jun 24 10:06:17.555928 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 351/686] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:06:17 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1277 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:06:17.914297 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-24304cf7-aead-4770-9989-99e07109ae81 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:17.915027 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-24304cf7-aead-4770-9989-99e07109ae81 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:17.921624 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-24304cf7-aead-4770-9989-99e07109ae81 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:17.922173 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-24304cf7-aead-4770-9989-99e07109ae81 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:17.923054 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-24304cf7-aead-4770-9989-99e07109ae81 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:17.923559 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-24304cf7-aead-4770-9989-99e07109ae81 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:18.061165 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-24304cf7-aead-4770-9989-99e07109ae81 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:18.069596 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-24304cf7-aead-4770-9989-99e07109ae81 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1507 microversion: 2.1 time: 0.159148 Jun 24 10:06:18.079510 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 352/687] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:17 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:06:18.487215 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-19b58071-8660-4a7a-b3e8-6d4392ba1de3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:18.488054 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-19b58071-8660-4a7a-b3e8-6d4392ba1de3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:18.492050 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:06:18.496029 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-19b58071-8660-4a7a-b3e8-6d4392ba1de3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:18.496516 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-19b58071-8660-4a7a-b3e8-6d4392ba1de3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:18.497309 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-19b58071-8660-4a7a-b3e8-6d4392ba1de3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:18.497773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-19b58071-8660-4a7a-b3e8-6d4392ba1de3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:18.616862 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-32437508-6496-4186-b3ce-4a4d90e7ef04 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "POST /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.758531 Jun 24 10:06:18.623487 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 336/688] 10.222.0.26 () {60 vars in 1322 bytes} [Fri Jun 24 10:06:15 2022] POST /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05/os-volume_attachments => generated 194 bytes in 2766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:06:18.640188 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-ef355740-6fa0-4d07-8c59-7c72a3e6c768 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:18.640913 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-ef355740-6fa0-4d07-8c59-7c72a3e6c768 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:18.648485 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ef355740-6fa0-4d07-8c59-7c72a3e6c768 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:18.649288 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ef355740-6fa0-4d07-8c59-7c72a3e6c768 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:18.650261 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ef355740-6fa0-4d07-8c59-7c72a3e6c768 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:18.651348 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ef355740-6fa0-4d07-8c59-7c72a3e6c768 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:18.678348 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-19b58071-8660-4a7a-b3e8-6d4392ba1de3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:18.688997 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-19b58071-8660-4a7a-b3e8-6d4392ba1de3 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022" status: 200 len: 1363 microversion: 2.1 time: 0.204057 Jun 24 10:06:18.688997 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 353/689] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:18 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022 => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:06:18.893068 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-9fc768b4-3f5a-444d-935b-27d55c463f19 req-d590c838-606b-4d46-9735-8998847b3140 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81e2c8c9-5c99-476a-a8a0-adce8022d022", "tag": "8729f211-3e97-49aa-abcb-f42c379588c6"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:06:18.904081 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-9fc768b4-3f5a-444d-935b-27d55c463f19 req-d590c838-606b-4d46-9735-8998847b3140 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:18.904351 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-9fc768b4-3f5a-444d-935b-27d55c463f19 req-d590c838-606b-4d46-9735-8998847b3140 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:18.905767 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-ef355740-6fa0-4d07-8c59-7c72a3e6c768 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:18.916084 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-ef355740-6fa0-4d07-8c59-7c72a3e6c768 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:18.917821 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-ef355740-6fa0-4d07-8c59-7c72a3e6c768 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:18.919495 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-ef355740-6fa0-4d07-8c59-7c72a3e6c768 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1341 microversion: 2.20 time: 0.294358 Jun 24 10:06:18.920063 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 337/690] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:06:18 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1341 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:06:18.926810 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-9fc768b4-3f5a-444d-935b-27d55c463f19 req-d590c838-606b-4d46-9735-8998847b3140 service nova] Creating event network-changed:8729f211-3e97-49aa-abcb-f42c379588c6 for instance 81e2c8c9-5c99-476a-a8a0-adce8022d022 on hv-cinder-84327 Jun 24 10:06:18.932944 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-9fc768b4-3f5a-444d-935b-27d55c463f19 req-d590c838-606b-4d46-9735-8998847b3140 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044549 Jun 24 10:06:18.938022 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 354/691] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:06:19.087380 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-5cdc5019-df9f-40e3-b40c-c08360253c91 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:19.088268 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-5cdc5019-df9f-40e3-b40c-c08360253c91 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:19.095916 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5cdc5019-df9f-40e3-b40c-c08360253c91 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:19.096767 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5cdc5019-df9f-40e3-b40c-c08360253c91 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:19.099535 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5cdc5019-df9f-40e3-b40c-c08360253c91 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:19.100010 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5cdc5019-df9f-40e3-b40c-c08360253c91 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:19.444542 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-5cdc5019-df9f-40e3-b40c-c08360253c91 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:19.457879 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-5cdc5019-df9f-40e3-b40c-c08360253c91 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1507 microversion: 2.1 time: 0.369962 Jun 24 10:06:19.457879 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 338/692] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:19 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1507 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:19.705678 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-18dfb333-258b-4f9c-a5c7-e787e2d3f61c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:19.706391 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-18dfb333-258b-4f9c-a5c7-e787e2d3f61c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:19.713928 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-18dfb333-258b-4f9c-a5c7-e787e2d3f61c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:19.714386 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-18dfb333-258b-4f9c-a5c7-e787e2d3f61c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:19.719217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-18dfb333-258b-4f9c-a5c7-e787e2d3f61c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:19.719217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-18dfb333-258b-4f9c-a5c7-e787e2d3f61c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:19.858513 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-18dfb333-258b-4f9c-a5c7-e787e2d3f61c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:19.869820 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-18dfb333-258b-4f9c-a5c7-e787e2d3f61c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022" status: 200 len: 1363 microversion: 2.1 time: 0.169488 Jun 24 10:06:19.870400 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 355/693] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:19 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:19.938614 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-f4636d13-075b-4f2a-b479-fd7247200500 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:19.939870 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-f4636d13-075b-4f2a-b479-fd7247200500 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:19.946224 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f4636d13-075b-4f2a-b479-fd7247200500 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:19.946709 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f4636d13-075b-4f2a-b479-fd7247200500 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:19.947429 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f4636d13-075b-4f2a-b479-fd7247200500 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:19.947872 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f4636d13-075b-4f2a-b479-fd7247200500 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:19.952362 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:06:20.061760 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-f4636d13-075b-4f2a-b479-fd7247200500 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:20.071284 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-f4636d13-075b-4f2a-b479-fd7247200500 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:20.072829 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-f4636d13-075b-4f2a-b479-fd7247200500 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:20.074174 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-f4636d13-075b-4f2a-b479-fd7247200500 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1339 microversion: 2.20 time: 0.139307 Jun 24 10:06:20.074729 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 339/694] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:06:19 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1339 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:06:20.470946 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-f461c726-ec8e-48f7-857c-5e856d091257 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:20.472236 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-f461c726-ec8e-48f7-857c-5e856d091257 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:20.479228 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f461c726-ec8e-48f7-857c-5e856d091257 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:20.479776 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f461c726-ec8e-48f7-857c-5e856d091257 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:20.480489 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f461c726-ec8e-48f7-857c-5e856d091257 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:20.480951 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f461c726-ec8e-48f7-857c-5e856d091257 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:20.515709 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f461c726-ec8e-48f7-857c-5e856d091257 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:20.516177 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f461c726-ec8e-48f7-857c-5e856d091257 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:20.516645 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.objects.instance [None req-f461c726-ec8e-48f7-857c-5e856d091257 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lazy-loading 'fault' on Instance uuid e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb {{(pid=124979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:06:20.558249 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-f461c726-ec8e-48f7-857c-5e856d091257 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:20.566789 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-f461c726-ec8e-48f7-857c-5e856d091257 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 200 len: 1311 microversion: 2.1 time: 0.100269 Jun 24 10:06:20.567598 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 356/695] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:20 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:20.887430 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-6f237703-c22a-4d2e-b18f-6ea9c5a4b3c4 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:20.895511 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-6f237703-c22a-4d2e-b18f-6ea9c5a4b3c4 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:20.895775 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6f237703-c22a-4d2e-b18f-6ea9c5a4b3c4 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:20.896151 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6f237703-c22a-4d2e-b18f-6ea9c5a4b3c4 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:20.897012 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6f237703-c22a-4d2e-b18f-6ea9c5a4b3c4 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:20.897446 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6f237703-c22a-4d2e-b18f-6ea9c5a4b3c4 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:20.968388 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-09381de9-d4b6-4e09-9be4-b62813fbb75a req-536a0547-845b-4bd2-b66a-eab6ccbdc902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb", "name": "network-vif-deleted", "tag": "17817cc3-73eb-4391-b5de-08503690fb3b"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:06:20.978046 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-09381de9-d4b6-4e09-9be4-b62813fbb75a req-536a0547-845b-4bd2-b66a-eab6ccbdc902 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:20.978577 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-09381de9-d4b6-4e09-9be4-b62813fbb75a req-536a0547-845b-4bd2-b66a-eab6ccbdc902 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:20.991043 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-09381de9-d4b6-4e09-9be4-b62813fbb75a req-536a0547-845b-4bd2-b66a-eab6ccbdc902 service nova] Creating event network-vif-deleted:17817cc3-73eb-4391-b5de-08503690fb3b for instance e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb on hv-cinder-84327 Jun 24 10:06:20.996093 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-09381de9-d4b6-4e09-9be4-b62813fbb75a req-536a0547-845b-4bd2-b66a-eab6ccbdc902 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031453 Jun 24 10:06:20.996825 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 357/696] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:06:21.035517 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-6f237703-c22a-4d2e-b18f-6ea9c5a4b3c4 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:21.042992 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-6f237703-c22a-4d2e-b18f-6ea9c5a4b3c4 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022" status: 200 len: 1363 microversion: 2.1 time: 0.159674 Jun 24 10:06:21.043509 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 340/697] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:20 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:21.093460 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-aca73bb5-3f9c-4784-a116-54003a440c00 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:21.094833 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-aca73bb5-3f9c-4784-a116-54003a440c00 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:21.101932 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-aca73bb5-3f9c-4784-a116-54003a440c00 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:21.102375 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-aca73bb5-3f9c-4784-a116-54003a440c00 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:21.103205 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-aca73bb5-3f9c-4784-a116-54003a440c00 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:21.103637 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-aca73bb5-3f9c-4784-a116-54003a440c00 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:21.259132 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-aca73bb5-3f9c-4784-a116-54003a440c00 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:21.269153 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-aca73bb5-3f9c-4784-a116-54003a440c00 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:21.270831 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-aca73bb5-3f9c-4784-a116-54003a440c00 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:21.272105 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-aca73bb5-3f9c-4784-a116-54003a440c00 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1407 microversion: 2.20 time: 0.182859 Jun 24 10:06:21.276259 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 358/698] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:06:21 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:06:21.584691 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-d79fdf7e-3d09-4fda-8878-3a579c6e092d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:21.592723 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-d79fdf7e-3d09-4fda-8878-3a579c6e092d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:21.592723 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell0:SELECT=2 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:06:21.592723 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell0:SELECT=6 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:06:21.594606 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d79fdf7e-3d09-4fda-8878-3a579c6e092d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:21.595129 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d79fdf7e-3d09-4fda-8878-3a579c6e092d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:21.596195 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d79fdf7e-3d09-4fda-8878-3a579c6e092d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:21.596867 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d79fdf7e-3d09-4fda-8878-3a579c6e092d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:21.611786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.wsgi [None req-d79fdf7e-3d09-4fda-8878-3a579c6e092d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] HTTP exception thrown: Instance e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb could not be found. Jun 24 10:06:21.613578 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-d79fdf7e-3d09-4fda-8878-3a579c6e092d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Request method failure captured: Jun 24 10:06:21.613578 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: request: GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb HTTP/1.1 Jun 24 10:06:21.613578 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept: application/json Jun 24 10:06:21.613578 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept-Encoding: identity Jun 24 10:06:21.613578 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Connection: close Jun 24 10:06:21.613578 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Length: 0 Jun 24 10:06:21.613578 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Type: application/json Jun 24 10:06:21.613578 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Host: 10.222.0.26 Jun 24 10:06:21.613578 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Openstack-System-Scope: None Jun 24 10:06:21.613578 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: User-Agent: python-urllib3/1.26.9 Jun 24 10:06:21.613578 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Auth-Token: gAAAAABitYtobSN6CjiACUjTyXEql4xKzLsglXk-l3YaDQLAZo4vs-RgMAM3IADpJhPypTRBSlCExLMR--YbzFicmjbwkbj-OJB_zzYsnZ_Gbqq5n_CnUB_ypRKgSN3BcXHuMsmCBlnf0I3kK4SJFeqnT6AupdpkZsj57O8A_owmEagvxq33osI Jun 24 10:06:21.613578 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Id: None Jun 24 10:06:21.613578 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Name: None Jun 24 10:06:21.613578 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Identity-Status: Confirmed Jun 24 10:06:21.613578 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Is-Admin-Project: True Jun 24 10:06:21.613578 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Id: default Jun 24 10:06:21.613578 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Name: Default Jun 24 10:06:21.613578 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Id: ddf89eff2d584c508a967f1686090be1 Jun 24 10:06:21.613578 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1125620466 Jun 24 10:06:21.613578 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Role: reader,member Jun 24 10:06:21.613578 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Roles: reader,member Jun 24 10:06:21.615280 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ddf89eff2d584c508a967f1686090be1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ddf89eff2d584c508a967f1686090be1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ddf89eff2d584c508a967f1686090be1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ddf89eff2d584c508a967f1686090be1"}]}] Jun 24 10:06:21.615280 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1125620466 Jun 24 10:06:21.615280 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Id: ddf89eff2d584c508a967f1686090be1 Jun 24 10:06:21.615280 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1125620466 Jun 24 10:06:21.615280 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User: tempest-ServerRescueNegativeTestJSON-1125620466-project Jun 24 10:06:21.615280 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Id: default Jun 24 10:06:21.615280 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Name: Default Jun 24 10:06:21.615280 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Id: b03913e742104648977aa5d61347f38e Jun 24 10:06:21.615280 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1125620466-project Jun 24 10:06:21.615280 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: method: > Jun 24 10:06:21.615280 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: exception: Instance e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb could not be found. Jun 24 10:06:21.615280 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: action_args: {'id': 'e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb'} Jun 24 10:06:21.616310 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:06:21.616310 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:06:21.616310 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:06:21.616310 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:06:21.616310 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:06:21.616310 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:06:21.616310 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:06:21.616310 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:06:21.616310 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:06:21.616310 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:06:21.616310 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb could not be found. Jun 24 10:06:21.616310 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:06:21.616310 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:06:21.616310 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:06:21.616310 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:06:21.616310 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:06:21.616310 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:06:21.616310 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:06:21.616310 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:06:21.616310 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:06:21.618071 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:06:21.618071 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:06:21.618071 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:06:21.618071 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:06:21.618071 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:06:21.618071 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:06:21.618071 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:06:21.618071 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb could not be found. Jun 24 10:06:21.618071 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:06:21.618071 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:06:21.618071 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:06:21.618071 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:06:21.618071 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:06:21.618071 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:06:21.618071 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:06:21.618071 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:06:21.618071 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb could not be found. Jun 24 10:06:21.618071 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:06:21.619281 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-d79fdf7e-3d09-4fda-8878-3a579c6e092d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Returning 404 to user: Instance e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb could not be found. {{(pid=124980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:06:21.619281 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-d79fdf7e-3d09-4fda-8878-3a579c6e092d tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb" status: 404 len: 111 microversion: 2.1 time: 0.037417 Jun 24 10:06:21.619281 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 341/699] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:21 2022] GET /compute/v2.1/servers/e8f54e5e-4833-47a2-a1e4-bf1a76d8f9bb => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:06:21.625002 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-9f6a0b6f-143a-44b2-8203-051c655f4b0f tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:21.626462 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-9f6a0b6f-143a-44b2-8203-051c655f4b0f tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:21.634442 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9f6a0b6f-143a-44b2-8203-051c655f4b0f tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:21.642642 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9f6a0b6f-143a-44b2-8203-051c655f4b0f tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:21.642642 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9f6a0b6f-143a-44b2-8203-051c655f4b0f tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:21.642642 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9f6a0b6f-143a-44b2-8203-051c655f4b0f tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:21.661356 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-9f6a0b6f-143a-44b2-8203-051c655f4b0f tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Going to try to terminate instance {{(pid=124979) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:06:21.664521 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:06:22.014038 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-9f6a0b6f-143a-44b2-8203-051c655f4b0f tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 204 len: 0 microversion: 2.1 time: 0.392624 Jun 24 10:06:22.014704 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 359/700] 10.222.0.26 () {58 vars in 1238 bytes} [Fri Jun 24 10:06:21 2022] DELETE /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 10:06:22.023150 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-f93b4d26-4239-4b28-9b49-2d7e0ec0a9b6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:22.023794 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-f93b4d26-4239-4b28-9b49-2d7e0ec0a9b6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:22.032180 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f93b4d26-4239-4b28-9b49-2d7e0ec0a9b6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:22.032642 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f93b4d26-4239-4b28-9b49-2d7e0ec0a9b6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:22.033414 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f93b4d26-4239-4b28-9b49-2d7e0ec0a9b6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:22.033890 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f93b4d26-4239-4b28-9b49-2d7e0ec0a9b6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:22.061211 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-e163a1a4-be9e-46c9-90c0-b52b2af2c33d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:22.062276 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-e163a1a4-be9e-46c9-90c0-b52b2af2c33d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:22.070033 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e163a1a4-be9e-46c9-90c0-b52b2af2c33d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:22.070483 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e163a1a4-be9e-46c9-90c0-b52b2af2c33d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:22.071467 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e163a1a4-be9e-46c9-90c0-b52b2af2c33d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:22.071939 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e163a1a4-be9e-46c9-90c0-b52b2af2c33d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:22.166410 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-f93b4d26-4239-4b28-9b49-2d7e0ec0a9b6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:22.174750 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-f93b4d26-4239-4b28-9b49-2d7e0ec0a9b6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1520 microversion: 2.1 time: 0.156003 Jun 24 10:06:22.175313 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 342/701] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:22 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:22.203743 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-e163a1a4-be9e-46c9-90c0-b52b2af2c33d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:22.211038 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-e163a1a4-be9e-46c9-90c0-b52b2af2c33d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022" status: 200 len: 1363 microversion: 2.1 time: 0.154290 Jun 24 10:06:22.211602 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 360/702] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:22 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:06:22.290500 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-73891a7e-465b-46f1-81fe-022e2bd12222 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:22.291279 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-73891a7e-465b-46f1-81fe-022e2bd12222 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:22.298327 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-73891a7e-465b-46f1-81fe-022e2bd12222 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:22.298771 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-73891a7e-465b-46f1-81fe-022e2bd12222 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:22.299525 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-73891a7e-465b-46f1-81fe-022e2bd12222 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:22.299955 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-73891a7e-465b-46f1-81fe-022e2bd12222 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:22.428437 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-73891a7e-465b-46f1-81fe-022e2bd12222 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:22.436817 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-73891a7e-465b-46f1-81fe-022e2bd12222 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:22.438294 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-73891a7e-465b-46f1-81fe-022e2bd12222 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:22.439381 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-73891a7e-465b-46f1-81fe-022e2bd12222 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1407 microversion: 2.20 time: 0.152770 Jun 24 10:06:22.439922 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 343/703] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:06:22 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:06:23.013859 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-56ed42d9-8cfc-4370-a13d-74731bfd4a80 req-d2a93af2-f97d-4d33-a471-212aec0e7bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03050a70-dac3-49b8-a4ab-e73de4421841", "tag": "66641946-e924-41f5-ad9f-d918c412d89d"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:06:23.023027 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-56ed42d9-8cfc-4370-a13d-74731bfd4a80 req-d2a93af2-f97d-4d33-a471-212aec0e7bc2 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:23.023610 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-56ed42d9-8cfc-4370-a13d-74731bfd4a80 req-d2a93af2-f97d-4d33-a471-212aec0e7bc2 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:23.034345 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-56ed42d9-8cfc-4370-a13d-74731bfd4a80 req-d2a93af2-f97d-4d33-a471-212aec0e7bc2 service nova] Creating event network-changed:66641946-e924-41f5-ad9f-d918c412d89d for instance 03050a70-dac3-49b8-a4ab-e73de4421841 on hv-cinder-84327 Jun 24 10:06:23.039315 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-56ed42d9-8cfc-4370-a13d-74731bfd4a80 req-d2a93af2-f97d-4d33-a471-212aec0e7bc2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029130 Jun 24 10:06:23.039927 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 361/704] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:06:23.192241 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-f0f90b82-9877-4a34-a110-104cc0a5aab6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:23.192853 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-f0f90b82-9877-4a34-a110-104cc0a5aab6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:23.199262 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f0f90b82-9877-4a34-a110-104cc0a5aab6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:23.199716 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f0f90b82-9877-4a34-a110-104cc0a5aab6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:23.200501 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f0f90b82-9877-4a34-a110-104cc0a5aab6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:23.200942 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f0f90b82-9877-4a34-a110-104cc0a5aab6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:23.228831 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-1078a124-9f85-4191-b96d-685ef6ab66ab tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:23.229561 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-1078a124-9f85-4191-b96d-685ef6ab66ab tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:23.235852 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1078a124-9f85-4191-b96d-685ef6ab66ab tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:23.236335 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1078a124-9f85-4191-b96d-685ef6ab66ab tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:23.237098 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1078a124-9f85-4191-b96d-685ef6ab66ab tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:23.237525 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1078a124-9f85-4191-b96d-685ef6ab66ab tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:23.341951 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-f0f90b82-9877-4a34-a110-104cc0a5aab6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:23.349563 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-f0f90b82-9877-4a34-a110-104cc0a5aab6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1520 microversion: 2.1 time: 0.161652 Jun 24 10:06:23.350129 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 344/705] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:23 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:23.377974 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-1078a124-9f85-4191-b96d-685ef6ab66ab tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:23.385383 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-1078a124-9f85-4191-b96d-685ef6ab66ab tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022" status: 200 len: 1363 microversion: 2.1 time: 0.160899 Jun 24 10:06:23.385957 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 362/706] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:23 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:06:23.457288 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-00133211-5721-40c6-be39-309c952e4d7c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:23.457908 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-00133211-5721-40c6-be39-309c952e4d7c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:23.464004 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-00133211-5721-40c6-be39-309c952e4d7c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:23.464498 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-00133211-5721-40c6-be39-309c952e4d7c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:23.465264 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-00133211-5721-40c6-be39-309c952e4d7c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:23.465702 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-00133211-5721-40c6-be39-309c952e4d7c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:23.593805 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-00133211-5721-40c6-be39-309c952e4d7c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:23.602257 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-00133211-5721-40c6-be39-309c952e4d7c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:23.603946 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-00133211-5721-40c6-be39-309c952e4d7c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:23.605126 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-00133211-5721-40c6-be39-309c952e4d7c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1407 microversion: 2.20 time: 0.151913 Jun 24 10:06:23.605675 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 345/707] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:06:23 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:06:24.366449 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-f42090b5-34e5-47a9-b226-8d1f2b940e59 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:24.367065 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-f42090b5-34e5-47a9-b226-8d1f2b940e59 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:24.369083 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell0:SELECT=2 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:06:24.370215 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell0:SELECT=18 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:06:24.375088 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f42090b5-34e5-47a9-b226-8d1f2b940e59 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:24.376469 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f42090b5-34e5-47a9-b226-8d1f2b940e59 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:24.376469 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f42090b5-34e5-47a9-b226-8d1f2b940e59 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:24.376799 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f42090b5-34e5-47a9-b226-8d1f2b940e59 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:24.402186 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-9b74e79a-9c35-4caa-9252-6a3e05d1c627 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:24.402950 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-9b74e79a-9c35-4caa-9252-6a3e05d1c627 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:24.410367 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9b74e79a-9c35-4caa-9252-6a3e05d1c627 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:24.410831 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9b74e79a-9c35-4caa-9252-6a3e05d1c627 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:24.411609 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9b74e79a-9c35-4caa-9252-6a3e05d1c627 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:24.412054 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9b74e79a-9c35-4caa-9252-6a3e05d1c627 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:24.507953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-f42090b5-34e5-47a9-b226-8d1f2b940e59 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:24.515441 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-f42090b5-34e5-47a9-b226-8d1f2b940e59 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1520 microversion: 2.1 time: 0.152839 Jun 24 10:06:24.516069 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 363/708] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:24 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:24.547342 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-9b74e79a-9c35-4caa-9252-6a3e05d1c627 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:24.554556 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-9b74e79a-9c35-4caa-9252-6a3e05d1c627 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022" status: 200 len: 1363 microversion: 2.1 time: 0.156211 Jun 24 10:06:24.555112 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 346/709] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:24 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:06:24.622785 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-82968389-0618-4765-961d-477d664e2375 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:24.623529 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-82968389-0618-4765-961d-477d664e2375 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:24.631048 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-82968389-0618-4765-961d-477d664e2375 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:24.631502 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-82968389-0618-4765-961d-477d664e2375 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:24.632428 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-82968389-0618-4765-961d-477d664e2375 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:24.632868 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-82968389-0618-4765-961d-477d664e2375 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:24.763207 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-82968389-0618-4765-961d-477d664e2375 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:24.771719 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-82968389-0618-4765-961d-477d664e2375 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:24.773304 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-82968389-0618-4765-961d-477d664e2375 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:24.774408 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-82968389-0618-4765-961d-477d664e2375 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1407 microversion: 2.20 time: 0.155551 Jun 24 10:06:24.774979 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 364/710] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:06:24 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:06:25.212065 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-5ae2194e-31e3-4391-8f81-f8dcd0eabf44 req-4cd83d76-dad7-4546-8946-42f0f4fed75d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81e2c8c9-5c99-476a-a8a0-adce8022d022", "name": "network-vif-plugged", "status": "completed", "tag": "8729f211-3e97-49aa-abcb-f42c379588c6"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:06:25.220776 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-5ae2194e-31e3-4391-8f81-f8dcd0eabf44 req-4cd83d76-dad7-4546-8946-42f0f4fed75d service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:25.221227 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-5ae2194e-31e3-4391-8f81-f8dcd0eabf44 req-4cd83d76-dad7-4546-8946-42f0f4fed75d service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:25.233219 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-5ae2194e-31e3-4391-8f81-f8dcd0eabf44 req-4cd83d76-dad7-4546-8946-42f0f4fed75d service nova] Creating event network-vif-plugged:8729f211-3e97-49aa-abcb-f42c379588c6 for instance 81e2c8c9-5c99-476a-a8a0-adce8022d022 on hv-cinder-84327 Jun 24 10:06:25.239066 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-5ae2194e-31e3-4391-8f81-f8dcd0eabf44 req-4cd83d76-dad7-4546-8946-42f0f4fed75d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030594 Jun 24 10:06:25.239677 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 347/711] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:06:25.532976 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-c5102d83-5758-45a0-a109-fc38aad64d79 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:25.534199 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-c5102d83-5758-45a0-a109-fc38aad64d79 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:25.540729 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c5102d83-5758-45a0-a109-fc38aad64d79 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:25.541169 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c5102d83-5758-45a0-a109-fc38aad64d79 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:25.541921 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c5102d83-5758-45a0-a109-fc38aad64d79 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:25.542356 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c5102d83-5758-45a0-a109-fc38aad64d79 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:25.572375 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-177fd37b-99b7-4a29-b087-ed3a4faaff29 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:25.573092 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-177fd37b-99b7-4a29-b087-ed3a4faaff29 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:25.579754 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-177fd37b-99b7-4a29-b087-ed3a4faaff29 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:25.580240 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-177fd37b-99b7-4a29-b087-ed3a4faaff29 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:25.581611 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-177fd37b-99b7-4a29-b087-ed3a4faaff29 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:25.582054 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-177fd37b-99b7-4a29-b087-ed3a4faaff29 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:25.677139 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-c5102d83-5758-45a0-a109-fc38aad64d79 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:25.684548 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-c5102d83-5758-45a0-a109-fc38aad64d79 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1520 microversion: 2.1 time: 0.155512 Jun 24 10:06:25.685139 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 365/712] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:25 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:25.719928 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-177fd37b-99b7-4a29-b087-ed3a4faaff29 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:25.727908 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-177fd37b-99b7-4a29-b087-ed3a4faaff29 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022" status: 200 len: 1363 microversion: 2.1 time: 0.160425 Jun 24 10:06:25.728495 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 348/713] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:25 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:06:25.792325 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-0a5b55d6-4c87-441a-88ae-012d6f71bae2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:25.792867 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-0a5b55d6-4c87-441a-88ae-012d6f71bae2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:25.799101 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0a5b55d6-4c87-441a-88ae-012d6f71bae2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:25.799549 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0a5b55d6-4c87-441a-88ae-012d6f71bae2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:25.800335 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0a5b55d6-4c87-441a-88ae-012d6f71bae2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:25.800795 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0a5b55d6-4c87-441a-88ae-012d6f71bae2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:25.932412 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-0a5b55d6-4c87-441a-88ae-012d6f71bae2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:25.936849 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-0a5b55d6-4c87-441a-88ae-012d6f71bae2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:25.938345 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-0a5b55d6-4c87-441a-88ae-012d6f71bae2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:25.939447 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-0a5b55d6-4c87-441a-88ae-012d6f71bae2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1407 microversion: 2.20 time: 0.151101 Jun 24 10:06:25.940533 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 366/714] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:06:25 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:06:26.700365 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-c99b3661-5aeb-4340-a893-1a33616b42b6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:26.700984 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-c99b3661-5aeb-4340-a893-1a33616b42b6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:26.708598 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c99b3661-5aeb-4340-a893-1a33616b42b6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:26.709058 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c99b3661-5aeb-4340-a893-1a33616b42b6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:26.709833 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c99b3661-5aeb-4340-a893-1a33616b42b6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:26.710275 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c99b3661-5aeb-4340-a893-1a33616b42b6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:26.744550 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-91f6ae3a-cfab-4582-9222-349fdcba2f5d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:26.745284 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-91f6ae3a-cfab-4582-9222-349fdcba2f5d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:26.752065 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-91f6ae3a-cfab-4582-9222-349fdcba2f5d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:26.753186 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-91f6ae3a-cfab-4582-9222-349fdcba2f5d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:26.754018 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-91f6ae3a-cfab-4582-9222-349fdcba2f5d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:26.754522 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-91f6ae3a-cfab-4582-9222-349fdcba2f5d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:26.886773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-91f6ae3a-cfab-4582-9222-349fdcba2f5d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:26.896648 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-91f6ae3a-cfab-4582-9222-349fdcba2f5d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022" status: 200 len: 1363 microversion: 2.1 time: 0.155324 Jun 24 10:06:26.897242 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 367/715] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:26 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:06:26.958768 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-b929e97a-59ac-4f39-8ce1-576601abd335 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:26.959441 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-b929e97a-59ac-4f39-8ce1-576601abd335 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:26.962434 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-c99b3661-5aeb-4340-a893-1a33616b42b6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:26.966050 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b929e97a-59ac-4f39-8ce1-576601abd335 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:26.966505 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b929e97a-59ac-4f39-8ce1-576601abd335 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:26.967332 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b929e97a-59ac-4f39-8ce1-576601abd335 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:26.967775 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b929e97a-59ac-4f39-8ce1-576601abd335 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:26.971591 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-c99b3661-5aeb-4340-a893-1a33616b42b6 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1520 microversion: 2.1 time: 0.275095 Jun 24 10:06:26.973750 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 349/716] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:26 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1520 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:27.118509 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-b929e97a-59ac-4f39-8ce1-576601abd335 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:27.130784 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-b929e97a-59ac-4f39-8ce1-576601abd335 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:27.142063 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-b929e97a-59ac-4f39-8ce1-576601abd335 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:27.143336 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-b929e97a-59ac-4f39-8ce1-576601abd335 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1407 microversion: 2.20 time: 0.189144 Jun 24 10:06:27.148735 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 368/717] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:06:26 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:06:27.275946 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-8bf12b81-66bc-49bd-bb59-23226570e961 req-48c883f7-d20b-48c2-9420-60b01f5a0120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6", "name": "network-vif-deleted", "tag": "be1d3537-038c-4ba5-84f5-566839e929b4"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:06:27.283965 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-8bf12b81-66bc-49bd-bb59-23226570e961 req-48c883f7-d20b-48c2-9420-60b01f5a0120 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:27.284443 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-8bf12b81-66bc-49bd-bb59-23226570e961 req-48c883f7-d20b-48c2-9420-60b01f5a0120 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:27.295338 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-8bf12b81-66bc-49bd-bb59-23226570e961 req-48c883f7-d20b-48c2-9420-60b01f5a0120 service nova] Creating event network-vif-deleted:be1d3537-038c-4ba5-84f5-566839e929b4 for instance ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 on hv-cinder-84327 Jun 24 10:06:27.301012 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-8bf12b81-66bc-49bd-bb59-23226570e961 req-48c883f7-d20b-48c2-9420-60b01f5a0120 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028662 Jun 24 10:06:27.301524 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 350/718] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:06:27.914319 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-7b57a4c5-af01-4b3d-b7a5-fc08d668f10c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:27.915126 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-7b57a4c5-af01-4b3d-b7a5-fc08d668f10c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:27.922178 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7b57a4c5-af01-4b3d-b7a5-fc08d668f10c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:27.922728 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7b57a4c5-af01-4b3d-b7a5-fc08d668f10c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:27.923517 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7b57a4c5-af01-4b3d-b7a5-fc08d668f10c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:27.924017 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7b57a4c5-af01-4b3d-b7a5-fc08d668f10c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:27.991499 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-4010c94a-ad64-4f52-a1ef-da7c5ade42a9 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:27.992276 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-4010c94a-ad64-4f52-a1ef-da7c5ade42a9 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:27.998666 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4010c94a-ad64-4f52-a1ef-da7c5ade42a9 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:28.004087 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4010c94a-ad64-4f52-a1ef-da7c5ade42a9 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:28.004087 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4010c94a-ad64-4f52-a1ef-da7c5ade42a9 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:28.004087 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4010c94a-ad64-4f52-a1ef-da7c5ade42a9 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:28.037944 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4010c94a-ad64-4f52-a1ef-da7c5ade42a9 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:28.038399 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4010c94a-ad64-4f52-a1ef-da7c5ade42a9 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:28.038862 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.objects.instance [None req-4010c94a-ad64-4f52-a1ef-da7c5ade42a9 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lazy-loading 'fault' on Instance uuid ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 {{(pid=124980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:06:28.088502 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-4010c94a-ad64-4f52-a1ef-da7c5ade42a9 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b03913e742104648977aa5d61347f38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddf89eff2d584c508a967f1686090be1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:28.089385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-7b57a4c5-af01-4b3d-b7a5-fc08d668f10c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:28.096939 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-4010c94a-ad64-4f52-a1ef-da7c5ade42a9 tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 200 len: 1311 microversion: 2.1 time: 0.109584 Jun 24 10:06:28.097523 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 351/719] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:27 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 1311 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:06:28.105787 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-7b57a4c5-af01-4b3d-b7a5-fc08d668f10c tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022" status: 200 len: 1363 microversion: 2.1 time: 0.187156 Jun 24 10:06:28.105787 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 369/720] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:27 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:28.174305 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-2bdbea25-a59e-4592-9aa6-01adb812c114 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:28.174984 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-2bdbea25-a59e-4592-9aa6-01adb812c114 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:28.181643 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2bdbea25-a59e-4592-9aa6-01adb812c114 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:28.182129 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2bdbea25-a59e-4592-9aa6-01adb812c114 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:28.183940 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2bdbea25-a59e-4592-9aa6-01adb812c114 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:28.184429 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2bdbea25-a59e-4592-9aa6-01adb812c114 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:28.322401 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2bdbea25-a59e-4592-9aa6-01adb812c114 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:28.330584 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2bdbea25-a59e-4592-9aa6-01adb812c114 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:28.332835 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2bdbea25-a59e-4592-9aa6-01adb812c114 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:28.334045 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-2bdbea25-a59e-4592-9aa6-01adb812c114 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1407 microversion: 2.20 time: 0.164518 Jun 24 10:06:28.334616 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 352/721] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:06:28 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:06:29.116400 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-b8c7ecea-2fd5-4d4b-9c8b-4b0ce08b7bcf tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:29.117063 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-b85f2b34-8d3f-4ade-997b-ea96c8d6e805 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:29.117425 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-b8c7ecea-2fd5-4d4b-9c8b-4b0ce08b7bcf tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] [instance: ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:29.118229 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-b85f2b34-8d3f-4ade-997b-ea96c8d6e805 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:29.123564 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b8c7ecea-2fd5-4d4b-9c8b-4b0ce08b7bcf tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:29.124022 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b8c7ecea-2fd5-4d4b-9c8b-4b0ce08b7bcf tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:29.124834 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b85f2b34-8d3f-4ade-997b-ea96c8d6e805 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:29.124981 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b8c7ecea-2fd5-4d4b-9c8b-4b0ce08b7bcf tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:29.125339 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b8c7ecea-2fd5-4d4b-9c8b-4b0ce08b7bcf tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:29.125477 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b85f2b34-8d3f-4ade-997b-ea96c8d6e805 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:29.126051 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b85f2b34-8d3f-4ade-997b-ea96c8d6e805 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:29.126486 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b85f2b34-8d3f-4ade-997b-ea96c8d6e805 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:29.140393 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.wsgi [None req-b8c7ecea-2fd5-4d4b-9c8b-4b0ce08b7bcf tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] HTTP exception thrown: Instance ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 could not be found. Jun 24 10:06:29.142066 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-b8c7ecea-2fd5-4d4b-9c8b-4b0ce08b7bcf tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Request method failure captured: Jun 24 10:06:29.142066 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: request: GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 HTTP/1.1 Jun 24 10:06:29.142066 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept: application/json Jun 24 10:06:29.142066 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept-Encoding: identity Jun 24 10:06:29.142066 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Connection: close Jun 24 10:06:29.142066 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Length: 0 Jun 24 10:06:29.142066 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Type: application/json Jun 24 10:06:29.142066 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Host: 10.222.0.26 Jun 24 10:06:29.142066 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Openstack-System-Scope: None Jun 24 10:06:29.142066 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: User-Agent: python-urllib3/1.26.9 Jun 24 10:06:29.142066 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Auth-Token: gAAAAABitYtobSN6CjiACUjTyXEql4xKzLsglXk-l3YaDQLAZo4vs-RgMAM3IADpJhPypTRBSlCExLMR--YbzFicmjbwkbj-OJB_zzYsnZ_Gbqq5n_CnUB_ypRKgSN3BcXHuMsmCBlnf0I3kK4SJFeqnT6AupdpkZsj57O8A_owmEagvxq33osI Jun 24 10:06:29.142066 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Id: None Jun 24 10:06:29.142066 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Name: None Jun 24 10:06:29.142066 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Identity-Status: Confirmed Jun 24 10:06:29.142066 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Is-Admin-Project: True Jun 24 10:06:29.142066 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Id: default Jun 24 10:06:29.142066 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Name: Default Jun 24 10:06:29.142066 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Id: ddf89eff2d584c508a967f1686090be1 Jun 24 10:06:29.142066 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1125620466 Jun 24 10:06:29.142066 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Role: reader,member Jun 24 10:06:29.142066 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Roles: reader,member Jun 24 10:06:29.143596 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ddf89eff2d584c508a967f1686090be1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ddf89eff2d584c508a967f1686090be1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ddf89eff2d584c508a967f1686090be1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ddf89eff2d584c508a967f1686090be1"}]}] Jun 24 10:06:29.143596 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1125620466 Jun 24 10:06:29.143596 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Id: ddf89eff2d584c508a967f1686090be1 Jun 24 10:06:29.143596 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1125620466 Jun 24 10:06:29.143596 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User: tempest-ServerRescueNegativeTestJSON-1125620466-project Jun 24 10:06:29.143596 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Id: default Jun 24 10:06:29.143596 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Name: Default Jun 24 10:06:29.143596 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Id: b03913e742104648977aa5d61347f38e Jun 24 10:06:29.143596 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1125620466-project Jun 24 10:06:29.143596 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: method: > Jun 24 10:06:29.143596 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: exception: Instance ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 could not be found. Jun 24 10:06:29.143596 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: action_args: {'id': 'ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6'} Jun 24 10:06:29.144493 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:06:29.144493 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:06:29.144493 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:06:29.144493 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:06:29.144493 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:06:29.144493 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:06:29.144493 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:06:29.144493 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:06:29.144493 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:06:29.144493 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:06:29.144493 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 could not be found. Jun 24 10:06:29.144493 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:06:29.144493 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:06:29.144493 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:06:29.144493 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:06:29.144493 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:06:29.144493 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:06:29.144493 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:06:29.144493 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:06:29.144493 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:06:29.145912 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:06:29.145912 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:06:29.145912 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:06:29.145912 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:06:29.145912 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:06:29.145912 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:06:29.145912 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:06:29.145912 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 could not be found. Jun 24 10:06:29.145912 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:06:29.145912 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:06:29.145912 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:06:29.145912 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:06:29.145912 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:06:29.145912 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:06:29.145912 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:06:29.145912 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:06:29.145912 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 could not be found. Jun 24 10:06:29.145912 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:06:29.147928 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-b8c7ecea-2fd5-4d4b-9c8b-4b0ce08b7bcf tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] Returning 404 to user: Instance ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 could not be found. {{(pid=124980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:06:29.149110 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-b8c7ecea-2fd5-4d4b-9c8b-4b0ce08b7bcf tempest-ServerRescueNegativeTestJSON-1125620466 tempest-ServerRescueNegativeTestJSON-1125620466-project] 10.222.0.26 "GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6" status: 404 len: 111 microversion: 2.1 time: 0.037335 Jun 24 10:06:29.149868 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 353/722] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:29 2022] GET /compute/v2.1/servers/ffec04c4-e58d-45ff-bca2-e9cdfeaf6da6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:06:29.274107 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-b85f2b34-8d3f-4ade-997b-ea96c8d6e805 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:29.277602 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-b85f2b34-8d3f-4ade-997b-ea96c8d6e805 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022" status: 200 len: 1550 microversion: 2.1 time: 0.166461 Jun 24 10:06:29.278218 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 370/723] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:29 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022 => generated 1550 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:29.294653 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-74f97276-0610-4c41-9609-9ec3b8630781 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:29.295163 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-74f97276-0610-4c41-9609-9ec3b8630781 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:29.302062 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-74f97276-0610-4c41-9609-9ec3b8630781 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:29.302548 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-74f97276-0610-4c41-9609-9ec3b8630781 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:29.303295 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-74f97276-0610-4c41-9609-9ec3b8630781 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:29.303739 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-74f97276-0610-4c41-9609-9ec3b8630781 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:29.353020 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-89876f4f-2369-4e2f-ba1e-79704966e856 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:29.353726 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-89876f4f-2369-4e2f-ba1e-79704966e856 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:29.359953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-89876f4f-2369-4e2f-ba1e-79704966e856 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:29.360587 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-89876f4f-2369-4e2f-ba1e-79704966e856 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:29.361423 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-89876f4f-2369-4e2f-ba1e-79704966e856 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:29.361997 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-89876f4f-2369-4e2f-ba1e-79704966e856 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:29.428576 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-74f97276-0610-4c41-9609-9ec3b8630781 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.137912 Jun 24 10:06:29.429547 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 354/724] 10.222.0.26 () {58 vars in 1274 bytes} [Fri Jun 24 10:06:29 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022/os-interface => generated 285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:06:29.620523 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-89876f4f-2369-4e2f-ba1e-79704966e856 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:29.636283 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-89876f4f-2369-4e2f-ba1e-79704966e856 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:29.638357 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-89876f4f-2369-4e2f-ba1e-79704966e856 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:29.639650 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-89876f4f-2369-4e2f-ba1e-79704966e856 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1407 microversion: 2.20 time: 0.290600 Jun 24 10:06:29.640610 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 371/725] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:06:29 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1407 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:06:30.659412 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-152a1b9b-30c5-43ed-85de-908d33c3ed7b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:30.660929 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-152a1b9b-30c5-43ed-85de-908d33c3ed7b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:30.667874 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-152a1b9b-30c5-43ed-85de-908d33c3ed7b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:30.668607 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-152a1b9b-30c5-43ed-85de-908d33c3ed7b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:30.669646 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-152a1b9b-30c5-43ed-85de-908d33c3ed7b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:30.670594 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-152a1b9b-30c5-43ed-85de-908d33c3ed7b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:30.923079 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-113bb26e-e58e-4bb5-a5d8-71e290f3ac18 req-5cefe0dd-4400-4b37-893c-9f92934f00e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81e2c8c9-5c99-476a-a8a0-adce8022d022", "tag": "8729f211-3e97-49aa-abcb-f42c379588c6"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:06:30.933235 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-113bb26e-e58e-4bb5-a5d8-71e290f3ac18 req-5cefe0dd-4400-4b37-893c-9f92934f00e6 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:30.933968 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-113bb26e-e58e-4bb5-a5d8-71e290f3ac18 req-5cefe0dd-4400-4b37-893c-9f92934f00e6 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:30.947298 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-113bb26e-e58e-4bb5-a5d8-71e290f3ac18 req-5cefe0dd-4400-4b37-893c-9f92934f00e6 service nova] Creating event network-changed:8729f211-3e97-49aa-abcb-f42c379588c6 for instance 81e2c8c9-5c99-476a-a8a0-adce8022d022 on hv-cinder-84327 Jun 24 10:06:30.953777 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-113bb26e-e58e-4bb5-a5d8-71e290f3ac18 req-5cefe0dd-4400-4b37-893c-9f92934f00e6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100179 Jun 24 10:06:30.954647 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 372/726] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:06:30.967080 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-152a1b9b-30c5-43ed-85de-908d33c3ed7b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:30.976212 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-152a1b9b-30c5-43ed-85de-908d33c3ed7b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:30.977729 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-152a1b9b-30c5-43ed-85de-908d33c3ed7b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:30.979168 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-152a1b9b-30c5-43ed-85de-908d33c3ed7b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1407 microversion: 2.20 time: 0.324252 Jun 24 10:06:30.979746 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 355/727] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:06:30 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1407 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:06:31.999020 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-c25dac20-0575-4816-948d-7a73bb0bb4a7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:32.000195 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-c25dac20-0575-4816-948d-7a73bb0bb4a7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:32.007782 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c25dac20-0575-4816-948d-7a73bb0bb4a7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:32.008251 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c25dac20-0575-4816-948d-7a73bb0bb4a7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:32.009022 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c25dac20-0575-4816-948d-7a73bb0bb4a7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:32.009482 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c25dac20-0575-4816-948d-7a73bb0bb4a7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:32.184029 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-c25dac20-0575-4816-948d-7a73bb0bb4a7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:32.196491 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-c25dac20-0575-4816-948d-7a73bb0bb4a7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:32.198110 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-c25dac20-0575-4816-948d-7a73bb0bb4a7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:32.199351 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-c25dac20-0575-4816-948d-7a73bb0bb4a7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1407 microversion: 2.20 time: 0.205266 Jun 24 10:06:32.199827 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 373/728] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:06:31 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:06:33.220639 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-7e78a494-1803-4910-b6da-8487694149ba tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:33.222658 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-7e78a494-1803-4910-b6da-8487694149ba tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:33.234676 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7e78a494-1803-4910-b6da-8487694149ba tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:33.235131 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7e78a494-1803-4910-b6da-8487694149ba tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:33.236149 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7e78a494-1803-4910-b6da-8487694149ba tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:33.237272 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7e78a494-1803-4910-b6da-8487694149ba tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:33.447630 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-7e78a494-1803-4910-b6da-8487694149ba tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:33.455827 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-7e78a494-1803-4910-b6da-8487694149ba tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:33.457392 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-7e78a494-1803-4910-b6da-8487694149ba tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:33.458501 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-7e78a494-1803-4910-b6da-8487694149ba tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1407 microversion: 2.20 time: 0.243310 Jun 24 10:06:33.459067 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 356/729] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:06:33 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:06:34.477064 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-5e89afb5-5478-46c3-8b31-adf3b56632a6 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:34.484336 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-5e89afb5-5478-46c3-8b31-adf3b56632a6 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:34.484967 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5e89afb5-5478-46c3-8b31-adf3b56632a6 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:34.485426 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5e89afb5-5478-46c3-8b31-adf3b56632a6 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:34.486326 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5e89afb5-5478-46c3-8b31-adf3b56632a6 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:34.486863 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5e89afb5-5478-46c3-8b31-adf3b56632a6 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:34.622736 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-5e89afb5-5478-46c3-8b31-adf3b56632a6 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:34.631885 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-5e89afb5-5478-46c3-8b31-adf3b56632a6 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:34.633404 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-5e89afb5-5478-46c3-8b31-adf3b56632a6 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:34.634546 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-5e89afb5-5478-46c3-8b31-adf3b56632a6 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1407 microversion: 2.20 time: 0.161631 Jun 24 10:06:34.635309 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 374/730] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:06:34 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:06:35.653220 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-1b9d8924-3652-42ab-8258-226bfe0f83f3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:35.653827 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-1b9d8924-3652-42ab-8258-226bfe0f83f3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:35.661085 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1b9d8924-3652-42ab-8258-226bfe0f83f3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:35.661623 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1b9d8924-3652-42ab-8258-226bfe0f83f3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:35.662246 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1b9d8924-3652-42ab-8258-226bfe0f83f3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:35.662676 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1b9d8924-3652-42ab-8258-226bfe0f83f3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:35.798750 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-1b9d8924-3652-42ab-8258-226bfe0f83f3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:35.808756 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-1b9d8924-3652-42ab-8258-226bfe0f83f3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:35.810246 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-1b9d8924-3652-42ab-8258-226bfe0f83f3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:35.811449 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-1b9d8924-3652-42ab-8258-226bfe0f83f3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1407 microversion: 2.20 time: 0.162018 Jun 24 10:06:35.812003 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 357/731] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:06:35 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:06:36.489557 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-57258e50-f6fc-4b7a-b530-40bd89b945ff req-e7fc6a43-273c-4c08-b92a-0e60e96aa0e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03050a70-dac3-49b8-a4ab-e73de4421841", "name": "network-vif-plugged", "status": "completed", "tag": "66641946-e924-41f5-ad9f-d918c412d89d"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:06:36.499919 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-57258e50-f6fc-4b7a-b530-40bd89b945ff req-e7fc6a43-273c-4c08-b92a-0e60e96aa0e5 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:36.503684 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-57258e50-f6fc-4b7a-b530-40bd89b945ff req-e7fc6a43-273c-4c08-b92a-0e60e96aa0e5 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:36.512786 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-57258e50-f6fc-4b7a-b530-40bd89b945ff req-e7fc6a43-273c-4c08-b92a-0e60e96aa0e5 service nova] Creating event network-vif-plugged:66641946-e924-41f5-ad9f-d918c412d89d for instance 03050a70-dac3-49b8-a4ab-e73de4421841 on hv-cinder-84327 Jun 24 10:06:36.517907 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-57258e50-f6fc-4b7a-b530-40bd89b945ff req-e7fc6a43-273c-4c08-b92a-0e60e96aa0e5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032605 Jun 24 10:06:36.519080 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 375/732] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:06:36.829910 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-6620b184-586f-4270-a4bb-3bdca3822a2b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:36.830531 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-6620b184-586f-4270-a4bb-3bdca3822a2b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:36.837518 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6620b184-586f-4270-a4bb-3bdca3822a2b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:36.837970 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6620b184-586f-4270-a4bb-3bdca3822a2b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:36.838756 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6620b184-586f-4270-a4bb-3bdca3822a2b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:36.839358 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6620b184-586f-4270-a4bb-3bdca3822a2b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:36.858297 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=100 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:06:37.038528 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-6620b184-586f-4270-a4bb-3bdca3822a2b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:37.046504 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-6620b184-586f-4270-a4bb-3bdca3822a2b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:37.048314 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-6620b184-586f-4270-a4bb-3bdca3822a2b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:37.049915 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-6620b184-586f-4270-a4bb-3bdca3822a2b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1407 microversion: 2.20 time: 0.223666 Jun 24 10:06:37.050480 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 358/733] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:06:36 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:06:38.084046 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-a821deea-14ee-423a-9ebc-95e3078bdb6c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:38.085624 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-a821deea-14ee-423a-9ebc-95e3078bdb6c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:38.095343 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a821deea-14ee-423a-9ebc-95e3078bdb6c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:38.095955 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a821deea-14ee-423a-9ebc-95e3078bdb6c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:38.096940 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a821deea-14ee-423a-9ebc-95e3078bdb6c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:38.097449 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a821deea-14ee-423a-9ebc-95e3078bdb6c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:38.359657 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-a821deea-14ee-423a-9ebc-95e3078bdb6c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:38.363796 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:06:38.370493 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-a821deea-14ee-423a-9ebc-95e3078bdb6c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:38.370493 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-a821deea-14ee-423a-9ebc-95e3078bdb6c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:38.371167 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-a821deea-14ee-423a-9ebc-95e3078bdb6c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1407 microversion: 2.20 time: 0.307216 Jun 24 10:06:38.371845 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 376/734] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:06:38 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1407 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:06:39.071676 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-cd54574c-a913-4dba-8ca0-87540b655154 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-425148660"}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:06:39.073192 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-cd54574c-a913-4dba-8ca0-87540b655154 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:39.084438 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-cd54574c-a913-4dba-8ca0-87540b655154 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:39.085321 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-cd54574c-a913-4dba-8ca0-87540b655154 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:39.086517 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-cd54574c-a913-4dba-8ca0-87540b655154 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:39.087220 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-cd54574c-a913-4dba-8ca0-87540b655154 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:39.243266 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.network.security_group_api [None req-cd54574c-a913-4dba-8ca0-87540b655154 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Removing security group 69854125-db12-434f-b67e-c4a42098b62d from port 9232a5f7-d95a-44a5-b49d-7664a4d75f80 Jun 24 10:06:39.390816 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-97550dc7-2645-4b8b-bd49-a1d6645614cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:39.391428 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-97550dc7-2645-4b8b-bd49-a1d6645614cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:39.416400 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-97550dc7-2645-4b8b-bd49-a1d6645614cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:39.417396 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-97550dc7-2645-4b8b-bd49-a1d6645614cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:39.418447 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-97550dc7-2645-4b8b-bd49-a1d6645614cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:39.419047 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-97550dc7-2645-4b8b-bd49-a1d6645614cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:39.686978 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-cd54574c-a913-4dba-8ca0-87540b655154 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "POST /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5/action" status: 202 len: 0 microversion: 2.1 time: 0.622054 Jun 24 10:06:39.688973 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-97550dc7-2645-4b8b-bd49-a1d6645614cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:39.692500 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 359/735] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Jun 24 10:06:39 2022] POST /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5/action => generated 0 bytes in 628 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:06:39.701104 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-97550dc7-2645-4b8b-bd49-a1d6645614cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:39.702741 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-97550dc7-2645-4b8b-bd49-a1d6645614cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:39.715601 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-97550dc7-2645-4b8b-bd49-a1d6645614cd tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1599 microversion: 2.20 time: 0.328880 Jun 24 10:06:39.716237 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 377/736] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:06:39 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1599 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:06:39.734608 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-e327222e-19d2-4327-8f44-eb251db6743f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:39.734608 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-e327222e-19d2-4327-8f44-eb251db6743f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:39.759493 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e327222e-19d2-4327-8f44-eb251db6743f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:39.759952 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e327222e-19d2-4327-8f44-eb251db6743f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:39.761974 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e327222e-19d2-4327-8f44-eb251db6743f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:39.762424 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e327222e-19d2-4327-8f44-eb251db6743f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:39.905882 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-e327222e-19d2-4327-8f44-eb251db6743f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.176296 Jun 24 10:06:39.906553 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 378/737] 10.222.0.26 () {60 vars in 1315 bytes} [Fri Jun 24 10:06:39 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841/os-interface => generated 284 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 10:06:39.987373 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-2d6874a4-e55d-4f81-8c8d-dcb61d6d736a req-2940e6a4-7a41-4f9a-9704-ac10ba0afb3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af9804ec-09cf-4bd7-bf69-83dc28a5d1d5", "tag": "9232a5f7-d95a-44a5-b49d-7664a4d75f80"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:06:40.003599 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-2d6874a4-e55d-4f81-8c8d-dcb61d6d736a req-2940e6a4-7a41-4f9a-9704-ac10ba0afb3c service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:40.004714 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-2d6874a4-e55d-4f81-8c8d-dcb61d6d736a req-2940e6a4-7a41-4f9a-9704-ac10ba0afb3c service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:40.035415 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-2d6874a4-e55d-4f81-8c8d-dcb61d6d736a req-2940e6a4-7a41-4f9a-9704-ac10ba0afb3c service nova] Creating event network-changed:9232a5f7-d95a-44a5-b49d-7664a4d75f80 for instance af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 on hv-cinder-84327 Jun 24 10:06:40.045899 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-2d6874a4-e55d-4f81-8c8d-dcb61d6d736a req-2940e6a4-7a41-4f9a-9704-ac10ba0afb3c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.343970 Jun 24 10:06:40.046784 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 360/738] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:06:41.010399 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-4598c751-dd96-4446-af96-11de8f261a00 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:41.011464 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-4598c751-dd96-4446-af96-11de8f261a00 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: eaab6bae-ac96-452b-9d70-dded946abf05] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:41.021660 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4598c751-dd96-4446-af96-11de8f261a00 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:41.023281 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4598c751-dd96-4446-af96-11de8f261a00 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:41.024248 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4598c751-dd96-4446-af96-11de8f261a00 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:41.024831 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4598c751-dd96-4446-af96-11de8f261a00 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:41.114023 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.objects.instance [None req-4598c751-dd96-4446-af96-11de8f261a00 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lazy-loading 'services' on Instance uuid eaab6bae-ac96-452b-9d70-dded946abf05 {{(pid=124979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:06:41.373152 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-4598c751-dd96-4446-af96-11de8f261a00 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "DELETE /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05/os-volume_attachments/5cbbaa28-3604-4820-b394-fb7c2e2bf060" status: 202 len: 0 microversion: 2.1 time: 0.366652 Jun 24 10:06:41.387524 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 379/739] 10.222.0.26 () {58 vars in 1415 bytes} [Fri Jun 24 10:06:41 2022] DELETE /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05/os-volume_attachments/5cbbaa28-3604-4820-b394-fb7c2e2bf060 => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:06:41.697358 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-56f3ad3e-ae46-4e35-8eb9-18efdef1a6f2 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:41.700802 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-56f3ad3e-ae46-4e35-8eb9-18efdef1a6f2 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:41.713070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:06:41.717227 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-56f3ad3e-ae46-4e35-8eb9-18efdef1a6f2 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:41.717972 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-56f3ad3e-ae46-4e35-8eb9-18efdef1a6f2 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:41.718978 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-56f3ad3e-ae46-4e35-8eb9-18efdef1a6f2 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:41.719630 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-56f3ad3e-ae46-4e35-8eb9-18efdef1a6f2 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:41.830338 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.objects.instance [None req-56f3ad3e-ae46-4e35-8eb9-18efdef1a6f2 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lazy-loading 'services' on Instance uuid af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 {{(pid=124980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:06:41.882537 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-a6b11ff7-b4f8-4666-ae14-0700f5378ba2 req-766099c6-5a3f-41d9-a7e8-0f4eb1fcd293 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03050a70-dac3-49b8-a4ab-e73de4421841", "tag": "66641946-e924-41f5-ad9f-d918c412d89d"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:06:41.896565 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-a6b11ff7-b4f8-4666-ae14-0700f5378ba2 req-766099c6-5a3f-41d9-a7e8-0f4eb1fcd293 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:41.897339 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-a6b11ff7-b4f8-4666-ae14-0700f5378ba2 req-766099c6-5a3f-41d9-a7e8-0f4eb1fcd293 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:41.937229 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-a6b11ff7-b4f8-4666-ae14-0700f5378ba2 req-766099c6-5a3f-41d9-a7e8-0f4eb1fcd293 service nova] Creating event network-changed:66641946-e924-41f5-ad9f-d918c412d89d for instance 03050a70-dac3-49b8-a4ab-e73de4421841 on hv-cinder-84327 Jun 24 10:06:41.964635 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-a6b11ff7-b4f8-4666-ae14-0700f5378ba2 req-766099c6-5a3f-41d9-a7e8-0f4eb1fcd293 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086143 Jun 24 10:06:41.966308 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 380/740] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:06:42.069109 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-f4fcc470-a551-4fae-828f-ae0456a4f01c req-aada5d95-0fb8-474b-80a3-093fdf472211 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af9804ec-09cf-4bd7-bf69-83dc28a5d1d5", "tag": "9232a5f7-d95a-44a5-b49d-7664a4d75f80"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:06:42.081727 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-f4fcc470-a551-4fae-828f-ae0456a4f01c req-aada5d95-0fb8-474b-80a3-093fdf472211 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:42.082182 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-f4fcc470-a551-4fae-828f-ae0456a4f01c req-aada5d95-0fb8-474b-80a3-093fdf472211 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:42.112431 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-f4fcc470-a551-4fae-828f-ae0456a4f01c req-aada5d95-0fb8-474b-80a3-093fdf472211 service nova] Creating event network-changed:9232a5f7-d95a-44a5-b49d-7664a4d75f80 for instance af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 on hv-cinder-84327 Jun 24 10:06:42.130468 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-f4fcc470-a551-4fae-828f-ae0456a4f01c req-aada5d95-0fb8-474b-80a3-093fdf472211 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066057 Jun 24 10:06:42.138072 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 381/741] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:06:42.190412 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-56f3ad3e-ae46-4e35-8eb9-18efdef1a6f2 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "DELETE /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5/os-volume_attachments/f0ea2e0d-4a78-447d-b4b8-342c0acde89c" status: 202 len: 0 microversion: 2.1 time: 0.505732 Jun 24 10:06:42.202380 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-2ffd05bb-11d0-49b0-82b5-8a423d4ba1ed tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:42.208690 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-2ffd05bb-11d0-49b0-82b5-8a423d4ba1ed tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:42.220072 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 361/742] 10.222.0.26 () {58 vars in 1415 bytes} [Fri Jun 24 10:06:41 2022] DELETE /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5/os-volume_attachments/f0ea2e0d-4a78-447d-b4b8-342c0acde89c => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:06:42.220320 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2ffd05bb-11d0-49b0-82b5-8a423d4ba1ed tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:42.220858 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2ffd05bb-11d0-49b0-82b5-8a423d4ba1ed tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:42.222300 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2ffd05bb-11d0-49b0-82b5-8a423d4ba1ed tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:42.222762 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2ffd05bb-11d0-49b0-82b5-8a423d4ba1ed tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:42.285437 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-2ffd05bb-11d0-49b0-82b5-8a423d4ba1ed tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086569 Jun 24 10:06:42.286716 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 382/743] 10.222.0.26 () {58 vars in 1301 bytes} [Fri Jun 24 10:06:42 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:06:43.301634 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-e611c050-9284-4e05-9e98-8d9af6c03c3e tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:43.302889 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-e611c050-9284-4e05-9e98-8d9af6c03c3e tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:43.315485 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e611c050-9284-4e05-9e98-8d9af6c03c3e tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:43.315485 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e611c050-9284-4e05-9e98-8d9af6c03c3e tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:43.316483 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e611c050-9284-4e05-9e98-8d9af6c03c3e tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:43.316942 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e611c050-9284-4e05-9e98-8d9af6c03c3e tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:43.401615 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-6ecfe259-d588-4fd3-be87-d650cabf5e9a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Action: 'create', calling method: .version_select at 0x7f0309999550>, body: {"keypair": {"name": "tempest-keypair-1603570819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1/kfxfNg7FQH/77zYOdlV5HYhVByiT8Sh3Cj5udBNwvLj/4cPOEaC6u9qjzSod8ItkiPcceHGvhbZrgbJOvin1eW/fvCBLP3xUNU9AsdSJoVXXaImpTZtZjTSF8VKIoQ=="}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:06:43.404019 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-e611c050-9284-4e05-9e98-8d9af6c03c3e tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107198 Jun 24 10:06:43.409327 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 383/744] 10.222.0.26 () {58 vars in 1301 bytes} [Fri Jun 24 10:06:43 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:06:43.447738 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-6ecfe259-d588-4fd3-be87-d650cabf5e9a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Getting quotas for project 64b655c9ef0948c099f60649b9d5e78d. Resources: {'key_pairs'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:06:43.454899 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-6ecfe259-d588-4fd3-be87-d650cabf5e9a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Getting quotas for user f2c97e68f66142f9b502b215313f7e80 and project 64b655c9ef0948c099f60649b9d5e78d. Resources: {'key_pairs'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:06:43.575831 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-6ecfe259-d588-4fd3-be87-d650cabf5e9a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.297440 Jun 24 10:06:43.575831 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 362/745] 10.222.0.26 () {60 vars in 1158 bytes} [Fri Jun 24 10:06:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:06:43.618262 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-515696e0-b430-4075-9fea-217325a44cd8 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:43.618762 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-515696e0-b430-4075-9fea-217325a44cd8 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: eaab6bae-ac96-452b-9d70-dded946abf05] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:43.628915 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-515696e0-b430-4075-9fea-217325a44cd8 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:43.629373 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-515696e0-b430-4075-9fea-217325a44cd8 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:43.630896 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-515696e0-b430-4075-9fea-217325a44cd8 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:43.631502 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-515696e0-b430-4075-9fea-217325a44cd8 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:43.679166 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-515696e0-b430-4075-9fea-217325a44cd8 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: eaab6bae-ac96-452b-9d70-dded946abf05] Going to try to terminate instance {{(pid=124979) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:06:43.991349 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-515696e0-b430-4075-9fea-217325a44cd8 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "DELETE /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05" status: 204 len: 0 microversion: 2.1 time: 0.377627 Jun 24 10:06:43.992251 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 384/746] 10.222.0.26 () {58 vars in 1238 bytes} [Fri Jun 24 10:06:43 2022] DELETE /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:06:44.000507 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-61237942-5868-4ccd-b7c5-50156d27078a tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:44.003391 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-61237942-5868-4ccd-b7c5-50156d27078a tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: eaab6bae-ac96-452b-9d70-dded946abf05] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:44.012343 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-61237942-5868-4ccd-b7c5-50156d27078a tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:44.013192 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-61237942-5868-4ccd-b7c5-50156d27078a tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:44.014098 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-61237942-5868-4ccd-b7c5-50156d27078a tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:44.014622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-61237942-5868-4ccd-b7c5-50156d27078a tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:44.171571 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-61237942-5868-4ccd-b7c5-50156d27078a tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:44.183845 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-61237942-5868-4ccd-b7c5-50156d27078a tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05" status: 200 len: 1515 microversion: 2.1 time: 0.187189 Jun 24 10:06:44.184942 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 363/747] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:43 2022] GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05 => generated 1515 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:44.418687 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-9aa9f4ff-fe05-4e91-9130-185fa818a3f7 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:44.419871 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-9aa9f4ff-fe05-4e91-9130-185fa818a3f7 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:44.428543 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9aa9f4ff-fe05-4e91-9130-185fa818a3f7 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:44.429133 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9aa9f4ff-fe05-4e91-9130-185fa818a3f7 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:44.429972 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9aa9f4ff-fe05-4e91-9130-185fa818a3f7 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:44.430492 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9aa9f4ff-fe05-4e91-9130-185fa818a3f7 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:44.463284 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-9aa9f4ff-fe05-4e91-9130-185fa818a3f7 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049817 Jun 24 10:06:44.463861 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 385/748] 10.222.0.26 () {58 vars in 1301 bytes} [Fri Jun 24 10:06:44 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 10:06:44.474025 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-949c70cd-3c2a-4a1e-bc0a-a2293cf254bb tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:44.474530 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-949c70cd-3c2a-4a1e-bc0a-a2293cf254bb tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:44.481575 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-949c70cd-3c2a-4a1e-bc0a-a2293cf254bb tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:44.482039 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-949c70cd-3c2a-4a1e-bc0a-a2293cf254bb tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:44.482827 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-949c70cd-3c2a-4a1e-bc0a-a2293cf254bb tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:44.483289 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-949c70cd-3c2a-4a1e-bc0a-a2293cf254bb tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:44.566257 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.wsgi [None req-949c70cd-3c2a-4a1e-bc0a-a2293cf254bb tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] HTTP exception thrown: Instance af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 is not attached to volume f0ea2e0d-4a78-447d-b4b8-342c0acde89c Jun 24 10:06:44.582997 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-949c70cd-3c2a-4a1e-bc0a-a2293cf254bb tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Request method failure captured: Jun 24 10:06:44.582997 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: request: DELETE /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5/os-volume_attachments/f0ea2e0d-4a78-447d-b4b8-342c0acde89c HTTP/1.1 Jun 24 10:06:44.582997 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept: application/json Jun 24 10:06:44.582997 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept-Encoding: identity Jun 24 10:06:44.582997 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Connection: close Jun 24 10:06:44.582997 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Length: 0 Jun 24 10:06:44.582997 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Type: application/json Jun 24 10:06:44.582997 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Host: 10.222.0.26 Jun 24 10:06:44.582997 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Openstack-System-Scope: None Jun 24 10:06:44.582997 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: User-Agent: python-urllib3/1.26.9 Jun 24 10:06:44.582997 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Auth-Token: gAAAAABitYv0Rl7zKlUFyLFU1DxYJtOHfripyK2YJplLkwoAXEinfFf9ei1uMTEUiCcXeE1k-W45RN_d36AWm4OhZop0RKEeflpyRR5_AozZF31XM1HCz2EJ6iqob3WIY_23VxEwqONdVPycspLQh7Cnwu0J6MPW7ttYsRLtIdB_O2jkgnPC3rc Jun 24 10:06:44.582997 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Id: None Jun 24 10:06:44.582997 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Name: None Jun 24 10:06:44.582997 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Identity-Status: Confirmed Jun 24 10:06:44.582997 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Is-Admin-Project: True Jun 24 10:06:44.582997 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Id: default Jun 24 10:06:44.582997 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Name: Default Jun 24 10:06:44.582997 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Id: a8f15fa49a284e409bdcabcca90ece04 Jun 24 10:06:44.582997 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Name: tempest-TestMinimumBasicScenario-269091427 Jun 24 10:06:44.582997 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Role: reader,member Jun 24 10:06:44.582997 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Roles: reader,member Jun 24 10:06:44.584750 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a8f15fa49a284e409bdcabcca90ece04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a8f15fa49a284e409bdcabcca90ece04", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a8f15fa49a284e409bdcabcca90ece04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a8f15fa49a284e409bdcabcca90ece04"}]}] Jun 24 10:06:44.584750 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant: tempest-TestMinimumBasicScenario-269091427 Jun 24 10:06:44.584750 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Id: a8f15fa49a284e409bdcabcca90ece04 Jun 24 10:06:44.584750 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Name: tempest-TestMinimumBasicScenario-269091427 Jun 24 10:06:44.584750 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User: tempest-TestMinimumBasicScenario-269091427-project Jun 24 10:06:44.584750 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Id: default Jun 24 10:06:44.584750 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Name: Default Jun 24 10:06:44.584750 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Id: 9832856bd6e348508d5e0c2f5c7f234e Jun 24 10:06:44.584750 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Name: tempest-TestMinimumBasicScenario-269091427-project Jun 24 10:06:44.584750 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: method: > Jun 24 10:06:44.584750 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: exception: Instance af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 is not attached to volume f0ea2e0d-4a78-447d-b4b8-342c0acde89c Jun 24 10:06:44.585612 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: action_args: {'server_id': 'af9804ec-09cf-4bd7-bf69-83dc28a5d1d5', 'id': 'f0ea2e0d-4a78-447d-b4b8-342c0acde89c'} Jun 24 10:06:44.585612 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:06:44.585612 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:06:44.585612 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 24 10:06:44.585612 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 24 10:06:44.585612 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 10:06:44.585612 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 10:06:44.585612 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 24 10:06:44.585612 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 24 10:06:44.585612 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f0ea2e0d-4a78-447d-b4b8-342c0acde89c. Jun 24 10:06:44.585612 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:06:44.585612 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:06:44.585612 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:06:44.585612 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:06:44.585612 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:06:44.585612 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:06:44.585612 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:06:44.585612 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:06:44.585612 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:06:44.586991 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:06:44.586991 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 24 10:06:44.586991 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 24 10:06:44.586991 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 is not attached to volume f0ea2e0d-4a78-447d-b4b8-342c0acde89c Jun 24 10:06:44.586991 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:06:44.586991 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:06:44.586991 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:06:44.586991 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:06:44.586991 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:06:44.586991 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:06:44.586991 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:06:44.586991 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:06:44.586991 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 is not attached to volume f0ea2e0d-4a78-447d-b4b8-342c0acde89c Jun 24 10:06:44.586991 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:06:44.586991 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-949c70cd-3c2a-4a1e-bc0a-a2293cf254bb tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Returning 404 to user: Instance af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 is not attached to volume f0ea2e0d-4a78-447d-b4b8-342c0acde89c {{(pid=124980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:06:44.587952 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-949c70cd-3c2a-4a1e-bc0a-a2293cf254bb tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "DELETE /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5/os-volume_attachments/f0ea2e0d-4a78-447d-b4b8-342c0acde89c" status: 404 len: 154 microversion: 2.1 time: 0.114769 Jun 24 10:06:44.587952 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 364/749] 10.222.0.26 () {58 vars in 1415 bytes} [Fri Jun 24 10:06:44 2022] DELETE /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5/os-volume_attachments/f0ea2e0d-4a78-447d-b4b8-342c0acde89c => generated 154 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:06:45.206414 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-cecb32a2-bad9-40ed-8185-4f496bb49e0d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:45.207064 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-cecb32a2-bad9-40ed-8185-4f496bb49e0d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: eaab6bae-ac96-452b-9d70-dded946abf05] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:45.216377 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-cecb32a2-bad9-40ed-8185-4f496bb49e0d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:45.216925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-cecb32a2-bad9-40ed-8185-4f496bb49e0d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:45.218179 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-cecb32a2-bad9-40ed-8185-4f496bb49e0d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:45.219422 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-cecb32a2-bad9-40ed-8185-4f496bb49e0d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:45.443029 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-cecb32a2-bad9-40ed-8185-4f496bb49e0d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:45.454522 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-cecb32a2-bad9-40ed-8185-4f496bb49e0d tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05" status: 200 len: 1515 microversion: 2.1 time: 0.255620 Jun 24 10:06:45.463444 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 386/750] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:45 2022] GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05 => generated 1515 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:45.967399 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-df27de1f-9865-4059-ad2e-506c5f59f718 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:45.969642 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-df27de1f-9865-4059-ad2e-506c5f59f718 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:45.985993 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-df27de1f-9865-4059-ad2e-506c5f59f718 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:45.986443 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-df27de1f-9865-4059-ad2e-506c5f59f718 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:45.992075 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-df27de1f-9865-4059-ad2e-506c5f59f718 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:45.995852 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-df27de1f-9865-4059-ad2e-506c5f59f718 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:46.088661 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-df27de1f-9865-4059-ad2e-506c5f59f718 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Going to try to terminate instance {{(pid=124980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:06:46.469588 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-df27de1f-9865-4059-ad2e-506c5f59f718 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "DELETE /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 204 len: 0 microversion: 2.1 time: 0.519344 Jun 24 10:06:46.471539 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 365/751] 10.222.0.26 () {58 vars in 1238 bytes} [Fri Jun 24 10:06:45 2022] DELETE /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:06:46.473290 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-aa350067-fa75-454a-92c0-cf4a8ed426ce tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:46.474765 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-aa350067-fa75-454a-92c0-cf4a8ed426ce tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: eaab6bae-ac96-452b-9d70-dded946abf05] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:46.485462 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-15d716fd-1d9b-4569-86aa-105d8d7e40a7 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:46.486294 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-15d716fd-1d9b-4569-86aa-105d8d7e40a7 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:46.488631 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-aa350067-fa75-454a-92c0-cf4a8ed426ce tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:46.489587 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-aa350067-fa75-454a-92c0-cf4a8ed426ce tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:46.492430 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-aa350067-fa75-454a-92c0-cf4a8ed426ce tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:46.492882 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-aa350067-fa75-454a-92c0-cf4a8ed426ce tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:46.502050 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-15d716fd-1d9b-4569-86aa-105d8d7e40a7 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:46.505969 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-15d716fd-1d9b-4569-86aa-105d8d7e40a7 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:46.507862 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-15d716fd-1d9b-4569-86aa-105d8d7e40a7 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:46.508834 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-15d716fd-1d9b-4569-86aa-105d8d7e40a7 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:46.599099 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-aa350067-fa75-454a-92c0-cf4a8ed426ce tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:46.624903 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-aa350067-fa75-454a-92c0-cf4a8ed426ce tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05" status: 200 len: 1473 microversion: 2.1 time: 0.155744 Jun 24 10:06:46.626052 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 387/752] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:46 2022] GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05 => generated 1473 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:46.664046 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-af9d71f9-2219-4d40-8ba1-a1ec7fb09e97 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-589834387", "imageRef": "f6b1dddb-2953-41a2-99e3-00aeca441bd9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c1a62ba-de23-4693-a76a-ab88e859eb34"}], "security_groups": [{"name": "tempest-securitygroup--773595417"}], "key_name": "tempest-keypair-1603570819", "user_data": "}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:06:46.738336 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-15d716fd-1d9b-4569-86aa-105d8d7e40a7 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:46.746242 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-15d716fd-1d9b-4569-86aa-105d8d7e40a7 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1554 microversion: 2.1 time: 0.269689 Jun 24 10:06:46.747548 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 366/753] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:46 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1554 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:46.756997 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-b6a92a36-c0f1-4e1a-bf9f-7c6a9ddb9ab4 req-f5dc350d-7861-447a-8474-08e4a2b10124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaab6bae-ac96-452b-9d70-dded946abf05", "name": "network-vif-deleted", "tag": "09666df1-84b4-415c-9fc9-228adfcfdef3"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:06:46.774325 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-b6a92a36-c0f1-4e1a-bf9f-7c6a9ddb9ab4 req-f5dc350d-7861-447a-8474-08e4a2b10124 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:46.774325 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-b6a92a36-c0f1-4e1a-bf9f-7c6a9ddb9ab4 req-f5dc350d-7861-447a-8474-08e4a2b10124 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:46.783264 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-b6a92a36-c0f1-4e1a-bf9f-7c6a9ddb9ab4 req-f5dc350d-7861-447a-8474-08e4a2b10124 service nova] Creating event network-vif-deleted:09666df1-84b4-415c-9fc9-228adfcfdef3 for instance eaab6bae-ac96-452b-9d70-dded946abf05 on hv-cinder-84327 Jun 24 10:06:46.788611 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.network.neutron [None req-af9d71f9-2219-4d40-8ba1-a1ec7fb09e97 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] validate_networks() for [('2c1a62ba-de23-4693-a76a-ab88e859eb34', None, None, None, None, None)] {{(pid=124979) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:06:46.794907 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-b6a92a36-c0f1-4e1a-bf9f-7c6a9ddb9ab4 req-f5dc350d-7861-447a-8474-08e4a2b10124 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045931 Jun 24 10:06:46.795506 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 367/754] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:06:47.264099 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-af9d71f9-2219-4d40-8ba1-a1ec7fb09e97 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Flavor limits 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:06:47.264551 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-af9d71f9-2219-4d40-8ba1-a1ec7fb09e97 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Image limits 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:06:47.265032 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-af9d71f9-2219-4d40-8ba1-a1ec7fb09e97 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Flavor pref 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:06:47.265474 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-af9d71f9-2219-4d40-8ba1-a1ec7fb09e97 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Image pref 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:06:47.265890 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-af9d71f9-2219-4d40-8ba1-a1ec7fb09e97 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:06:47.275635 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-af9d71f9-2219-4d40-8ba1-a1ec7fb09e97 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:47.276089 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-af9d71f9-2219-4d40-8ba1-a1ec7fb09e97 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:47.276925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-af9d71f9-2219-4d40-8ba1-a1ec7fb09e97 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:47.277365 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-af9d71f9-2219-4d40-8ba1-a1ec7fb09e97 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:47.296336 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-af9d71f9-2219-4d40-8ba1-a1ec7fb09e97 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Getting quotas for project 64b655c9ef0948c099f60649b9d5e78d. Resources: {'instances', 'cores', 'ram'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:06:47.301074 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-af9d71f9-2219-4d40-8ba1-a1ec7fb09e97 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Getting quotas for user f2c97e68f66142f9b502b215313f7e80 and project 64b655c9ef0948c099f60649b9d5e78d. Resources: {'instances', 'cores', 'ram'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:06:47.317724 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-af9d71f9-2219-4d40-8ba1-a1ec7fb09e97 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Going to run 1 instances... {{(pid=124979) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:06:47.320215 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-af9d71f9-2219-4d40-8ba1-a1ec7fb09e97 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6b1dddb-2953-41a2-99e3-00aeca441bd9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124979) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:06:47.349525 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:06:47.478818 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-af9d71f9-2219-4d40-8ba1-a1ec7fb09e97 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.819936 Jun 24 10:06:47.482512 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 388/755] 10.222.0.26 () {60 vars in 1146 bytes} [Fri Jun 24 10:06:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:06:47.490482 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-45f673ed-230d-4c9d-afc0-bd95cdb7d911 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:47.491249 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-45f673ed-230d-4c9d-afc0-bd95cdb7d911 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:47.563032 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-45f673ed-230d-4c9d-afc0-bd95cdb7d911 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:47.570581 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-45f673ed-230d-4c9d-afc0-bd95cdb7d911 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487" status: 200 len: 1241 microversion: 2.1 time: 0.084843 Jun 24 10:06:47.571159 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 368/756] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:47 2022] GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:47.651265 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-ffb6b63e-abb1-4e0e-a245-0fde7749b45c tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:47.651879 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-ffb6b63e-abb1-4e0e-a245-0fde7749b45c tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: eaab6bae-ac96-452b-9d70-dded946abf05] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:47.659100 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ffb6b63e-abb1-4e0e-a245-0fde7749b45c tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:47.659564 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ffb6b63e-abb1-4e0e-a245-0fde7749b45c tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:47.664062 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ffb6b63e-abb1-4e0e-a245-0fde7749b45c tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:47.664062 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ffb6b63e-abb1-4e0e-a245-0fde7749b45c tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:47.725100 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-ffb6b63e-abb1-4e0e-a245-0fde7749b45c tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:47.733656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-ffb6b63e-abb1-4e0e-a245-0fde7749b45c tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05" status: 200 len: 1473 microversion: 2.1 time: 0.088335 Jun 24 10:06:47.734258 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 389/757] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:47 2022] GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05 => generated 1473 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:47.764798 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-67b3b3e2-9736-4d40-986b-55e443da8aa3 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:47.765105 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-67b3b3e2-9736-4d40-986b-55e443da8aa3 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:47.772481 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-67b3b3e2-9736-4d40-986b-55e443da8aa3 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:47.772930 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-67b3b3e2-9736-4d40-986b-55e443da8aa3 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:47.773698 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-67b3b3e2-9736-4d40-986b-55e443da8aa3 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:47.774129 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-67b3b3e2-9736-4d40-986b-55e443da8aa3 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:47.908524 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-67b3b3e2-9736-4d40-986b-55e443da8aa3 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:47.916259 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-67b3b3e2-9736-4d40-986b-55e443da8aa3 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1554 microversion: 2.1 time: 0.155660 Jun 24 10:06:47.916820 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 369/758] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:47 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:48.587925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-4c2f03ae-7c16-4d03-bf78-f1d755272502 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:48.588806 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-4c2f03ae-7c16-4d03-bf78-f1d755272502 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:48.647370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-4c2f03ae-7c16-4d03-bf78-f1d755272502 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:48.654740 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-4c2f03ae-7c16-4d03-bf78-f1d755272502 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487" status: 200 len: 1241 microversion: 2.1 time: 0.070641 Jun 24 10:06:48.655310 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 390/759] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:48 2022] GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:48.750860 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-263f957a-6818-47da-8526-aff2563cd2f1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:48.751475 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-263f957a-6818-47da-8526-aff2563cd2f1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: eaab6bae-ac96-452b-9d70-dded946abf05] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:48.758090 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-263f957a-6818-47da-8526-aff2563cd2f1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:48.758540 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-263f957a-6818-47da-8526-aff2563cd2f1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:48.759296 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-263f957a-6818-47da-8526-aff2563cd2f1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:48.759730 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-263f957a-6818-47da-8526-aff2563cd2f1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:48.792439 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-263f957a-6818-47da-8526-aff2563cd2f1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:48.793510 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-263f957a-6818-47da-8526-aff2563cd2f1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:48.793510 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.objects.instance [None req-263f957a-6818-47da-8526-aff2563cd2f1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lazy-loading 'fault' on Instance uuid eaab6bae-ac96-452b-9d70-dded946abf05 {{(pid=124980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:06:48.856924 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-263f957a-6818-47da-8526-aff2563cd2f1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cec38b1840f448e5a585469900801917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28def10792f645c491f98a134ff71dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:48.864778 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-263f957a-6818-47da-8526-aff2563cd2f1 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05" status: 200 len: 1309 microversion: 2.1 time: 0.117884 Jun 24 10:06:48.865356 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 370/760] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:48 2022] GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05 => generated 1309 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:48.890563 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-27959a62-b323-4902-be74-a99a8732d889 req-b6fccbaf-7bea-4224-b9a1-d5049198a7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af9804ec-09cf-4bd7-bf69-83dc28a5d1d5", "name": "network-vif-deleted", "tag": "9232a5f7-d95a-44a5-b49d-7664a4d75f80"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:06:48.900300 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-27959a62-b323-4902-be74-a99a8732d889 req-b6fccbaf-7bea-4224-b9a1-d5049198a7f5 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:48.903530 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-27959a62-b323-4902-be74-a99a8732d889 req-b6fccbaf-7bea-4224-b9a1-d5049198a7f5 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:48.912352 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-27959a62-b323-4902-be74-a99a8732d889 req-b6fccbaf-7bea-4224-b9a1-d5049198a7f5 service nova] Creating event network-vif-deleted:9232a5f7-d95a-44a5-b49d-7664a4d75f80 for instance af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 on hv-cinder-84327 Jun 24 10:06:48.918106 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-27959a62-b323-4902-be74-a99a8732d889 req-b6fccbaf-7bea-4224-b9a1-d5049198a7f5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031316 Jun 24 10:06:48.919025 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 391/761] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:06:48.933220 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-b3818a8b-04e9-4abb-ab01-1feb8f67efd8 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:48.934180 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-b3818a8b-04e9-4abb-ab01-1feb8f67efd8 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:48.940266 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b3818a8b-04e9-4abb-ab01-1feb8f67efd8 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:48.940731 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b3818a8b-04e9-4abb-ab01-1feb8f67efd8 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:48.941512 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b3818a8b-04e9-4abb-ab01-1feb8f67efd8 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:48.941956 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b3818a8b-04e9-4abb-ab01-1feb8f67efd8 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:49.015781 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-b3818a8b-04e9-4abb-ab01-1feb8f67efd8 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:49.024148 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-b3818a8b-04e9-4abb-ab01-1feb8f67efd8 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1512 microversion: 2.1 time: 0.094707 Jun 24 10:06:49.024718 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 371/762] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:48 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1512 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:06:49.673220 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-0315b280-e652-4af4-822a-52d80fdbc8d0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:49.673911 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-0315b280-e652-4af4-822a-52d80fdbc8d0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:49.680069 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0315b280-e652-4af4-822a-52d80fdbc8d0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:49.680544 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0315b280-e652-4af4-822a-52d80fdbc8d0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:49.681294 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0315b280-e652-4af4-822a-52d80fdbc8d0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:49.681722 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0315b280-e652-4af4-822a-52d80fdbc8d0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:49.745035 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-0315b280-e652-4af4-822a-52d80fdbc8d0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:49.753369 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-0315b280-e652-4af4-822a-52d80fdbc8d0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487" status: 200 len: 1293 microversion: 2.1 time: 0.085143 Jun 24 10:06:49.753930 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 392/763] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:49 2022] GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:49.887978 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-970083bc-abdc-46c3-ab98-7d5d4f9bd508 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:49.888912 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-970083bc-abdc-46c3-ab98-7d5d4f9bd508 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] [instance: eaab6bae-ac96-452b-9d70-dded946abf05] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:49.896251 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-970083bc-abdc-46c3-ab98-7d5d4f9bd508 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:49.896708 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-970083bc-abdc-46c3-ab98-7d5d4f9bd508 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:49.897704 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-970083bc-abdc-46c3-ab98-7d5d4f9bd508 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:49.897963 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-970083bc-abdc-46c3-ab98-7d5d4f9bd508 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:49.911713 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.wsgi [None req-970083bc-abdc-46c3-ab98-7d5d4f9bd508 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] HTTP exception thrown: Instance eaab6bae-ac96-452b-9d70-dded946abf05 could not be found. Jun 24 10:06:49.913408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-970083bc-abdc-46c3-ab98-7d5d4f9bd508 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Request method failure captured: Jun 24 10:06:49.913408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: request: GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05 HTTP/1.1 Jun 24 10:06:49.913408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept: application/json Jun 24 10:06:49.913408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept-Encoding: identity Jun 24 10:06:49.913408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Connection: close Jun 24 10:06:49.913408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Length: 0 Jun 24 10:06:49.913408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Type: application/json Jun 24 10:06:49.913408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Host: 10.222.0.26 Jun 24 10:06:49.913408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Openstack-System-Scope: None Jun 24 10:06:49.913408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: User-Agent: python-urllib3/1.26.9 Jun 24 10:06:49.913408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Auth-Token: gAAAAABitYwtHNgAIVY8GKei0PMLVA5Y3V2_y7vftVPt-kYSI9C6AkvJ1cYg7owg3a8JFbAiukD3Q6iTFxuZfJdtFh1lyYWE3rsEvmoMTF5HU9UXx81NTW7bCWEP9rl8KLn_9R3_Upi2a-a8jEvR0Fvu-qmqUgiyXR0YVyCJJ20pvYHi4UZkP-U Jun 24 10:06:49.913408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Id: None Jun 24 10:06:49.913408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Name: None Jun 24 10:06:49.913408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Identity-Status: Confirmed Jun 24 10:06:49.913408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Is-Admin-Project: True Jun 24 10:06:49.913408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Id: default Jun 24 10:06:49.913408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Name: Default Jun 24 10:06:49.913408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Id: 28def10792f645c491f98a134ff71dce Jun 24 10:06:49.913408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1274240851 Jun 24 10:06:49.913408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Role: reader,member Jun 24 10:06:49.913408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Roles: reader,member Jun 24 10:06:49.914971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/28def10792f645c491f98a134ff71dce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_28def10792f645c491f98a134ff71dce", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/28def10792f645c491f98a134ff71dce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/28def10792f645c491f98a134ff71dce"}]}] Jun 24 10:06:49.914971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant: tempest-VolumesSnapshotTestJSON-1274240851 Jun 24 10:06:49.914971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Id: 28def10792f645c491f98a134ff71dce Jun 24 10:06:49.914971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1274240851 Jun 24 10:06:49.914971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User: tempest-VolumesSnapshotTestJSON-1274240851-project Jun 24 10:06:49.914971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Id: default Jun 24 10:06:49.914971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Name: Default Jun 24 10:06:49.914971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Id: cec38b1840f448e5a585469900801917 Jun 24 10:06:49.914971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Name: tempest-VolumesSnapshotTestJSON-1274240851-project Jun 24 10:06:49.914971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: method: > Jun 24 10:06:49.914971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: exception: Instance eaab6bae-ac96-452b-9d70-dded946abf05 could not be found. Jun 24 10:06:49.914971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: action_args: {'id': 'eaab6bae-ac96-452b-9d70-dded946abf05'} Jun 24 10:06:49.924502 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:06:49.924502 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:06:49.924502 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:06:49.924502 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:06:49.924502 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:06:49.924502 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:06:49.924502 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:06:49.924502 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:06:49.924502 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:06:49.924502 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:06:49.924502 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaab6bae-ac96-452b-9d70-dded946abf05 could not be found. Jun 24 10:06:49.924502 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:06:49.924502 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:06:49.924502 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:06:49.924502 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:06:49.924502 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:06:49.924502 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:06:49.924502 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:06:49.924502 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:06:49.924502 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:06:49.926005 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:06:49.926005 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:06:49.926005 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:06:49.926005 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:06:49.926005 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:06:49.926005 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:06:49.926005 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:06:49.926005 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaab6bae-ac96-452b-9d70-dded946abf05 could not be found. Jun 24 10:06:49.926005 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:06:49.926005 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:06:49.926005 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:06:49.926005 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:06:49.926005 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:06:49.926005 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:06:49.926005 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:06:49.926005 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:06:49.926005 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaab6bae-ac96-452b-9d70-dded946abf05 could not be found. Jun 24 10:06:49.926005 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:06:49.927320 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-970083bc-abdc-46c3-ab98-7d5d4f9bd508 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] Returning 404 to user: Instance eaab6bae-ac96-452b-9d70-dded946abf05 could not be found. {{(pid=124980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:06:49.927320 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-970083bc-abdc-46c3-ab98-7d5d4f9bd508 tempest-VolumesSnapshotTestJSON-1274240851 tempest-VolumesSnapshotTestJSON-1274240851-project] 10.222.0.26 "GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05" status: 404 len: 111 microversion: 2.1 time: 0.030884 Jun 24 10:06:49.927320 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 372/764] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:49 2022] GET /compute/v2.1/servers/eaab6bae-ac96-452b-9d70-dded946abf05 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:06:50.041301 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-2dfbd353-8d61-40a1-898a-1b4b5d9248b2 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:50.042330 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-2dfbd353-8d61-40a1-898a-1b4b5d9248b2 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:50.048929 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2dfbd353-8d61-40a1-898a-1b4b5d9248b2 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:50.049563 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2dfbd353-8d61-40a1-898a-1b4b5d9248b2 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:50.050431 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2dfbd353-8d61-40a1-898a-1b4b5d9248b2 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:50.051069 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2dfbd353-8d61-40a1-898a-1b4b5d9248b2 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:50.239301 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2dfbd353-8d61-40a1-898a-1b4b5d9248b2 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:50.239866 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2dfbd353-8d61-40a1-898a-1b4b5d9248b2 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:50.240357 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.objects.instance [None req-2dfbd353-8d61-40a1-898a-1b4b5d9248b2 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lazy-loading 'fault' on Instance uuid af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 {{(pid=124979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:06:50.283407 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-2dfbd353-8d61-40a1-898a-1b4b5d9248b2 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9832856bd6e348508d5e0c2f5c7f234e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8f15fa49a284e409bdcabcca90ece04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:50.291481 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-2dfbd353-8d61-40a1-898a-1b4b5d9248b2 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 200 len: 1348 microversion: 2.1 time: 0.253837 Jun 24 10:06:50.292101 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 393/765] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:50 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 1348 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:50.770412 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-7a6c0262-673e-4e99-8b2a-d37a45ab80ba tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:50.771035 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-7a6c0262-673e-4e99-8b2a-d37a45ab80ba tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:50.779626 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7a6c0262-673e-4e99-8b2a-d37a45ab80ba tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:50.781572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7a6c0262-673e-4e99-8b2a-d37a45ab80ba tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:50.782606 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7a6c0262-673e-4e99-8b2a-d37a45ab80ba tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:50.783053 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7a6c0262-673e-4e99-8b2a-d37a45ab80ba tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:50.854210 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-7a6c0262-673e-4e99-8b2a-d37a45ab80ba tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:50.862263 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-7a6c0262-673e-4e99-8b2a-d37a45ab80ba tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487" status: 200 len: 1299 microversion: 2.1 time: 0.096393 Jun 24 10:06:50.862836 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 373/766] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:50 2022] GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487 => generated 1299 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:06:51.309011 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-3bf53374-00ab-49e7-b1a8-6da6a412ae10 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:51.309700 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-3bf53374-00ab-49e7-b1a8-6da6a412ae10 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] [instance: af9804ec-09cf-4bd7-bf69-83dc28a5d1d5] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:51.318086 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3bf53374-00ab-49e7-b1a8-6da6a412ae10 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:51.319133 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3bf53374-00ab-49e7-b1a8-6da6a412ae10 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:51.319883 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3bf53374-00ab-49e7-b1a8-6da6a412ae10 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:51.320351 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3bf53374-00ab-49e7-b1a8-6da6a412ae10 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:51.334967 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-3bf53374-00ab-49e7-b1a8-6da6a412ae10 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] HTTP exception thrown: Instance af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 could not be found. Jun 24 10:06:51.336696 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-3bf53374-00ab-49e7-b1a8-6da6a412ae10 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Request method failure captured: Jun 24 10:06:51.336696 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 HTTP/1.1 Jun 24 10:06:51.336696 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:06:51.336696 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:06:51.336696 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:06:51.336696 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 0 Jun 24 10:06:51.336696 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:06:51.336696 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:06:51.336696 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:06:51.336696 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:06:51.336696 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitYv0Rl7zKlUFyLFU1DxYJtOHfripyK2YJplLkwoAXEinfFf9ei1uMTEUiCcXeE1k-W45RN_d36AWm4OhZop0RKEeflpyRR5_AozZF31XM1HCz2EJ6iqob3WIY_23VxEwqONdVPycspLQh7Cnwu0J6MPW7ttYsRLtIdB_O2jkgnPC3rc Jun 24 10:06:51.336696 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:06:51.336696 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:06:51.336696 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:06:51.336696 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:06:51.336696 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:06:51.336696 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:06:51.336696 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: a8f15fa49a284e409bdcabcca90ece04 Jun 24 10:06:51.336696 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-TestMinimumBasicScenario-269091427 Jun 24 10:06:51.336696 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:06:51.336696 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:06:51.337997 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a8f15fa49a284e409bdcabcca90ece04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a8f15fa49a284e409bdcabcca90ece04", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a8f15fa49a284e409bdcabcca90ece04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a8f15fa49a284e409bdcabcca90ece04"}]}] Jun 24 10:06:51.337997 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-TestMinimumBasicScenario-269091427 Jun 24 10:06:51.337997 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: a8f15fa49a284e409bdcabcca90ece04 Jun 24 10:06:51.337997 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-TestMinimumBasicScenario-269091427 Jun 24 10:06:51.337997 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-TestMinimumBasicScenario-269091427-project Jun 24 10:06:51.337997 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:06:51.337997 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:06:51.337997 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: 9832856bd6e348508d5e0c2f5c7f234e Jun 24 10:06:51.337997 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-TestMinimumBasicScenario-269091427-project Jun 24 10:06:51.337997 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: > Jun 24 10:06:51.337997 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Instance af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 could not be found. Jun 24 10:06:51.337997 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'id': 'af9804ec-09cf-4bd7-bf69-83dc28a5d1d5'} Jun 24 10:06:51.338753 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:06:51.338753 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:06:51.338753 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:06:51.338753 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:06:51.338753 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:06:51.338753 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:06:51.338753 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:06:51.338753 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:06:51.338753 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:06:51.338753 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:06:51.338753 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 could not be found. Jun 24 10:06:51.338753 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:06:51.338753 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:06:51.338753 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:06:51.338753 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:06:51.338753 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:06:51.338753 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:06:51.338753 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:06:51.338753 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:06:51.338753 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:06:51.340773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:06:51.340773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:06:51.340773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:06:51.340773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:06:51.340773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:06:51.340773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:06:51.340773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:06:51.340773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 could not be found. Jun 24 10:06:51.340773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:06:51.340773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:06:51.340773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:06:51.340773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:06:51.340773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:06:51.340773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:06:51.340773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:06:51.340773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:06:51.340773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 could not be found. Jun 24 10:06:51.340773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:06:51.343073 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-3bf53374-00ab-49e7-b1a8-6da6a412ae10 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Returning 404 to user: Instance af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 could not be found. {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:06:51.343073 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-3bf53374-00ab-49e7-b1a8-6da6a412ae10 tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5" status: 404 len: 111 microversion: 2.1 time: 0.033224 Jun 24 10:06:51.343073 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 394/767] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:51 2022] GET /compute/v2.1/servers/af9804ec-09cf-4bd7-bf69-83dc28a5d1d5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:06:51.347095 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-8ce4098c-36de-4e72-a348-b41f9987176c tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] Calling method '.version_select at 0x7f03099790d0>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:51.423304 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-8ce4098c-36de-4e72-a348-b41f9987176c tempest-TestMinimumBasicScenario-269091427 tempest-TestMinimumBasicScenario-269091427-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-718733007" status: 202 len: 0 microversion: 2.1 time: 0.080230 Jun 24 10:06:51.425033 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 374/768] 10.222.0.26 () {58 vars in 1268 bytes} [Fri Jun 24 10:06:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-718733007 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:06:51.882416 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-8e906601-2004-431f-a71d-44486da3fa24 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:51.883045 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-8e906601-2004-431f-a71d-44486da3fa24 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:51.893761 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8e906601-2004-431f-a71d-44486da3fa24 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:51.896392 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8e906601-2004-431f-a71d-44486da3fa24 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:51.897319 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8e906601-2004-431f-a71d-44486da3fa24 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:51.899757 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8e906601-2004-431f-a71d-44486da3fa24 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:51.938541 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:06:52.060514 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-8e906601-2004-431f-a71d-44486da3fa24 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:52.067972 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-8e906601-2004-431f-a71d-44486da3fa24 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487" status: 200 len: 1366 microversion: 2.1 time: 0.192109 Jun 24 10:06:52.074697 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 395/769] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:51 2022] GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:52.156495 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-d7c0357b-2796-4015-8011-961369c135e2 req-c05fe079-bbd3-4312-aa46-da140d4c4c4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0aef362-32c9-463b-ba31-93ce5c561487", "tag": "c19c9d2a-aac2-4d52-be49-eee68aeee93f"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:06:52.170285 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-d7c0357b-2796-4015-8011-961369c135e2 req-c05fe079-bbd3-4312-aa46-da140d4c4c4d service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:52.170784 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-d7c0357b-2796-4015-8011-961369c135e2 req-c05fe079-bbd3-4312-aa46-da140d4c4c4d service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:52.183971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-d7c0357b-2796-4015-8011-961369c135e2 req-c05fe079-bbd3-4312-aa46-da140d4c4c4d service nova] Creating event network-changed:c19c9d2a-aac2-4d52-be49-eee68aeee93f for instance f0aef362-32c9-463b-ba31-93ce5c561487 on hv-cinder-84327 Jun 24 10:06:52.189164 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-d7c0357b-2796-4015-8011-961369c135e2 req-c05fe079-bbd3-4312-aa46-da140d4c4c4d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036227 Jun 24 10:06:52.190077 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 375/770] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:06:53.088774 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-6cc8e2b3-45aa-4bfb-87e7-4a8b1365b8be tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:53.089612 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-6cc8e2b3-45aa-4bfb-87e7-4a8b1365b8be tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:53.096402 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6cc8e2b3-45aa-4bfb-87e7-4a8b1365b8be tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:53.096887 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6cc8e2b3-45aa-4bfb-87e7-4a8b1365b8be tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:53.097661 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6cc8e2b3-45aa-4bfb-87e7-4a8b1365b8be tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:53.098103 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6cc8e2b3-45aa-4bfb-87e7-4a8b1365b8be tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:53.238236 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-6cc8e2b3-45aa-4bfb-87e7-4a8b1365b8be tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:53.246167 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-6cc8e2b3-45aa-4bfb-87e7-4a8b1365b8be tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487" status: 200 len: 1366 microversion: 2.1 time: 0.163879 Jun 24 10:06:53.246741 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 396/771] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:53 2022] GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:06:54.263860 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-1902db90-3f54-45be-9e44-92c9386c4c29 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:54.264601 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-1902db90-3f54-45be-9e44-92c9386c4c29 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:54.271393 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1902db90-3f54-45be-9e44-92c9386c4c29 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:54.271850 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1902db90-3f54-45be-9e44-92c9386c4c29 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:54.272650 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1902db90-3f54-45be-9e44-92c9386c4c29 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:54.273098 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1902db90-3f54-45be-9e44-92c9386c4c29 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:54.775307 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-1902db90-3f54-45be-9e44-92c9386c4c29 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:54.784343 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-1902db90-3f54-45be-9e44-92c9386c4c29 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487" status: 200 len: 1366 microversion: 2.1 time: 0.524621 Jun 24 10:06:54.793595 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 376/772] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:54 2022] GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487 => generated 1366 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:55.801774 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-c47fafe2-631a-48df-83e9-03f5838744b9 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:55.802399 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-c47fafe2-631a-48df-83e9-03f5838744b9 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:55.813721 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c47fafe2-631a-48df-83e9-03f5838744b9 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:55.814265 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c47fafe2-631a-48df-83e9-03f5838744b9 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:55.815603 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c47fafe2-631a-48df-83e9-03f5838744b9 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:55.816041 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c47fafe2-631a-48df-83e9-03f5838744b9 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:55.995716 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-c47fafe2-631a-48df-83e9-03f5838744b9 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:56.004437 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-c47fafe2-631a-48df-83e9-03f5838744b9 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487" status: 200 len: 1366 microversion: 2.1 time: 0.207546 Jun 24 10:06:56.004998 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 397/773] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:55 2022] GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:57.021508 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-ebfeb82d-2d26-4003-af4f-dcc8bb11b9a3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:57.022034 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-ebfeb82d-2d26-4003-af4f-dcc8bb11b9a3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:57.030745 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ebfeb82d-2d26-4003-af4f-dcc8bb11b9a3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:57.031081 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ebfeb82d-2d26-4003-af4f-dcc8bb11b9a3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:57.031852 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ebfeb82d-2d26-4003-af4f-dcc8bb11b9a3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:57.032497 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ebfeb82d-2d26-4003-af4f-dcc8bb11b9a3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:57.194939 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-ebfeb82d-2d26-4003-af4f-dcc8bb11b9a3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:57.211832 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-ebfeb82d-2d26-4003-af4f-dcc8bb11b9a3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487" status: 200 len: 1366 microversion: 2.1 time: 0.193827 Jun 24 10:06:57.213130 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 377/774] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:57 2022] GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:06:58.230037 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-4fcc61ab-bfa9-47f5-ac12-1b64fd4581ef tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:58.230576 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-4fcc61ab-bfa9-47f5-ac12-1b64fd4581ef tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:58.232973 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell0:SELECT=2 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:06:58.238439 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4fcc61ab-bfa9-47f5-ac12-1b64fd4581ef tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:58.238880 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4fcc61ab-bfa9-47f5-ac12-1b64fd4581ef tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:58.239660 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4fcc61ab-bfa9-47f5-ac12-1b64fd4581ef tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:58.240091 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4fcc61ab-bfa9-47f5-ac12-1b64fd4581ef tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:58.398405 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-4fcc61ab-bfa9-47f5-ac12-1b64fd4581ef tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:58.406990 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-4fcc61ab-bfa9-47f5-ac12-1b64fd4581ef tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487" status: 200 len: 1366 microversion: 2.1 time: 0.180735 Jun 24 10:06:58.407585 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 398/775] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:58 2022] GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:06:59.424997 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-68a0d1b2-81f2-410c-ad0c-38b42c6554bd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:06:59.425862 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-68a0d1b2-81f2-410c-ad0c-38b42c6554bd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:06:59.429099 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell0:SELECT=6 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:06:59.438113 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-68a0d1b2-81f2-410c-ad0c-38b42c6554bd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:59.439087 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-68a0d1b2-81f2-410c-ad0c-38b42c6554bd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:59.440730 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-68a0d1b2-81f2-410c-ad0c-38b42c6554bd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:06:59.441864 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-68a0d1b2-81f2-410c-ad0c-38b42c6554bd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:06:59.469917 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:06:59.691604 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-68a0d1b2-81f2-410c-ad0c-38b42c6554bd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:06:59.702264 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-68a0d1b2-81f2-410c-ad0c-38b42c6554bd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487" status: 200 len: 1366 microversion: 2.1 time: 0.280318 Jun 24 10:06:59.702264 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 378/776] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:06:59 2022] GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:07:00.721337 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-91a9df5b-d75d-401c-8f8c-d0c42d032eb1 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:00.721337 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-91a9df5b-d75d-401c-8f8c-d0c42d032eb1 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:00.724605 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell0:SELECT=8 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:07:00.727793 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-91a9df5b-d75d-401c-8f8c-d0c42d032eb1 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:00.728349 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-91a9df5b-d75d-401c-8f8c-d0c42d032eb1 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:00.729215 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-91a9df5b-d75d-401c-8f8c-d0c42d032eb1 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:00.729692 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-91a9df5b-d75d-401c-8f8c-d0c42d032eb1 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:00.925157 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-91a9df5b-d75d-401c-8f8c-d0c42d032eb1 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:00.933146 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-91a9df5b-d75d-401c-8f8c-d0c42d032eb1 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487" status: 200 len: 1366 microversion: 2.1 time: 0.218843 Jun 24 10:07:00.933830 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 399/777] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:07:00 2022] GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:07:01.761320 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-4b016d80-2570-4314-8073-e114d910bb64 req-0600ce74-dc0e-4ae3-9fab-86c2ac32b90f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0aef362-32c9-463b-ba31-93ce5c561487", "name": "network-vif-plugged", "status": "completed", "tag": "c19c9d2a-aac2-4d52-be49-eee68aeee93f"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:07:01.774933 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-4b016d80-2570-4314-8073-e114d910bb64 req-0600ce74-dc0e-4ae3-9fab-86c2ac32b90f service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:01.775668 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-4b016d80-2570-4314-8073-e114d910bb64 req-0600ce74-dc0e-4ae3-9fab-86c2ac32b90f service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:01.792325 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-4b016d80-2570-4314-8073-e114d910bb64 req-0600ce74-dc0e-4ae3-9fab-86c2ac32b90f service nova] Creating event network-vif-plugged:c19c9d2a-aac2-4d52-be49-eee68aeee93f for instance f0aef362-32c9-463b-ba31-93ce5c561487 on hv-cinder-84327 Jun 24 10:07:01.798265 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-4b016d80-2570-4314-8073-e114d910bb64 req-0600ce74-dc0e-4ae3-9fab-86c2ac32b90f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127161 Jun 24 10:07:01.799045 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 379/778] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:07:01.950294 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-e5935781-b7ce-4a6e-a553-0aa56bcc7d92 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:01.953362 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-e5935781-b7ce-4a6e-a553-0aa56bcc7d92 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:01.958164 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e5935781-b7ce-4a6e-a553-0aa56bcc7d92 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:01.958612 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e5935781-b7ce-4a6e-a553-0aa56bcc7d92 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:01.959423 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e5935781-b7ce-4a6e-a553-0aa56bcc7d92 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:01.959851 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e5935781-b7ce-4a6e-a553-0aa56bcc7d92 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:02.099613 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-e5935781-b7ce-4a6e-a553-0aa56bcc7d92 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:02.107961 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-e5935781-b7ce-4a6e-a553-0aa56bcc7d92 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487" status: 200 len: 1366 microversion: 2.1 time: 0.161393 Jun 24 10:07:02.108915 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 400/779] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:07:01 2022] GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:07:03.128731 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-5bd2d61e-39ec-4908-be65-9ad5df1c852f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:03.129513 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-5bd2d61e-39ec-4908-be65-9ad5df1c852f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:03.135739 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5bd2d61e-39ec-4908-be65-9ad5df1c852f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:03.136422 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5bd2d61e-39ec-4908-be65-9ad5df1c852f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:03.137160 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5bd2d61e-39ec-4908-be65-9ad5df1c852f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:03.137598 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5bd2d61e-39ec-4908-be65-9ad5df1c852f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:03.276529 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-5bd2d61e-39ec-4908-be65-9ad5df1c852f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:03.284328 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-5bd2d61e-39ec-4908-be65-9ad5df1c852f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487" status: 200 len: 1366 microversion: 2.1 time: 0.160901 Jun 24 10:07:03.284969 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 380/780] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:07:03 2022] GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:07:04.302197 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-9267a2e5-5298-4c16-b3da-4d7468686d81 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:04.302816 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-9267a2e5-5298-4c16-b3da-4d7468686d81 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:04.309458 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9267a2e5-5298-4c16-b3da-4d7468686d81 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:04.309903 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9267a2e5-5298-4c16-b3da-4d7468686d81 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:04.310677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9267a2e5-5298-4c16-b3da-4d7468686d81 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:04.311110 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9267a2e5-5298-4c16-b3da-4d7468686d81 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:04.444310 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-9267a2e5-5298-4c16-b3da-4d7468686d81 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:04.451766 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-9267a2e5-5298-4c16-b3da-4d7468686d81 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487" status: 200 len: 1366 microversion: 2.1 time: 0.153873 Jun 24 10:07:04.452344 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 401/781] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:07:04 2022] GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:07:05.468593 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-bd56e858-3c94-44f6-9fe8-991c7483f209 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:05.469183 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-bd56e858-3c94-44f6-9fe8-991c7483f209 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:05.475918 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-bd56e858-3c94-44f6-9fe8-991c7483f209 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:05.476396 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-bd56e858-3c94-44f6-9fe8-991c7483f209 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:05.477161 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-bd56e858-3c94-44f6-9fe8-991c7483f209 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:05.477594 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-bd56e858-3c94-44f6-9fe8-991c7483f209 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:05.636763 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-bd56e858-3c94-44f6-9fe8-991c7483f209 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:05.645176 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-bd56e858-3c94-44f6-9fe8-991c7483f209 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487" status: 200 len: 1366 microversion: 2.1 time: 0.180355 Jun 24 10:07:05.645668 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 381/782] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:07:05 2022] GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:07:06.662772 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-e8d211af-88c7-4061-8d51-1f33b6e4e9d0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:06.663387 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-e8d211af-88c7-4061-8d51-1f33b6e4e9d0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:06.670109 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e8d211af-88c7-4061-8d51-1f33b6e4e9d0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:06.670551 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e8d211af-88c7-4061-8d51-1f33b6e4e9d0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:06.671309 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e8d211af-88c7-4061-8d51-1f33b6e4e9d0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:06.671833 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e8d211af-88c7-4061-8d51-1f33b6e4e9d0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:06.805674 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-e8d211af-88c7-4061-8d51-1f33b6e4e9d0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:06.813252 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-e8d211af-88c7-4061-8d51-1f33b6e4e9d0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487" status: 200 len: 1557 microversion: 2.1 time: 0.155035 Jun 24 10:07:06.813884 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 402/783] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:07:06 2022] GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:07:06.829908 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-a5a9036f-67aa-453a-8a10-1743553d57b7 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:06.831041 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-a5a9036f-67aa-453a-8a10-1743553d57b7 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:06.837823 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a5a9036f-67aa-453a-8a10-1743553d57b7 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:06.838253 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a5a9036f-67aa-453a-8a10-1743553d57b7 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:06.839012 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a5a9036f-67aa-453a-8a10-1743553d57b7 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:06.839439 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a5a9036f-67aa-453a-8a10-1743553d57b7 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:06.917794 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-a5a9036f-67aa-453a-8a10-1743553d57b7 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091804 Jun 24 10:07:06.918417 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 382/784] 10.222.0.26 () {58 vars in 1274 bytes} [Fri Jun 24 10:07:06 2022] GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:07:07.988997 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-3c79acc7-7fe6-4f5a-8020-f83ed1e33b69 req-d467ab00-2a4e-444f-b2c1-50ca7f3bc6f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0aef362-32c9-463b-ba31-93ce5c561487", "tag": "c19c9d2a-aac2-4d52-be49-eee68aeee93f"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:07:07.998492 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-3c79acc7-7fe6-4f5a-8020-f83ed1e33b69 req-d467ab00-2a4e-444f-b2c1-50ca7f3bc6f3 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:07.999805 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-3c79acc7-7fe6-4f5a-8020-f83ed1e33b69 req-d467ab00-2a4e-444f-b2c1-50ca7f3bc6f3 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:08.011822 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-3c79acc7-7fe6-4f5a-8020-f83ed1e33b69 req-d467ab00-2a4e-444f-b2c1-50ca7f3bc6f3 service nova] Creating event network-changed:c19c9d2a-aac2-4d52-be49-eee68aeee93f for instance f0aef362-32c9-463b-ba31-93ce5c561487 on hv-cinder-84327 Jun 24 10:07:08.017439 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-3c79acc7-7fe6-4f5a-8020-f83ed1e33b69 req-d467ab00-2a4e-444f-b2c1-50ca7f3bc6f3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032239 Jun 24 10:07:08.018800 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 403/785] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:07:14.677526 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-5626eba1-e342-45ca-9968-b4b537fff0a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:14.678061 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-5626eba1-e342-45ca-9968-b4b537fff0a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:14.680469 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:07:14.685424 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5626eba1-e342-45ca-9968-b4b537fff0a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:14.685908 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5626eba1-e342-45ca-9968-b4b537fff0a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:14.686685 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5626eba1-e342-45ca-9968-b4b537fff0a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:14.687126 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5626eba1-e342-45ca-9968-b4b537fff0a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:14.710238 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-5626eba1-e342-45ca-9968-b4b537fff0a0 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022/ips" status: 200 len: 146 microversion: 2.1 time: 0.037411 Jun 24 10:07:14.710805 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 383/786] 10.222.0.26 () {58 vars in 1247 bytes} [Fri Jun 24 10:07:14 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:07:16.223267 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-0333ea0f-f338-4f7e-a6d7-de2fae243beb tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da504a93-2d35-4f58-9d16-b6bf120ccd3f"}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:07:16.224471 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-0333ea0f-f338-4f7e-a6d7-de2fae243beb tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:16.230648 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0333ea0f-f338-4f7e-a6d7-de2fae243beb tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:16.231098 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0333ea0f-f338-4f7e-a6d7-de2fae243beb tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:16.231858 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0333ea0f-f338-4f7e-a6d7-de2fae243beb tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:16.232336 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0333ea0f-f338-4f7e-a6d7-de2fae243beb tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:17.064065 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-0333ea0f-f338-4f7e-a6d7-de2fae243beb tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "POST /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.845575 Jun 24 10:07:17.069318 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 404/787] 10.222.0.26 () {60 vars in 1322 bytes} [Fri Jun 24 10:07:16 2022] POST /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022/os-volume_attachments => generated 194 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:07:24.196669 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-b898fef5-d7e9-4dc4-b976-807a8f8a5537 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:24.197206 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-b898fef5-d7e9-4dc4-b976-807a8f8a5537 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:24.203277 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b898fef5-d7e9-4dc4-b976-807a8f8a5537 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:24.203724 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b898fef5-d7e9-4dc4-b976-807a8f8a5537 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:24.204513 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b898fef5-d7e9-4dc4-b976-807a8f8a5537 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:24.204947 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b898fef5-d7e9-4dc4-b976-807a8f8a5537 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:24.227531 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-b898fef5-d7e9-4dc4-b976-807a8f8a5537 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841/ips" status: 200 len: 151 microversion: 2.20 time: 0.035385 Jun 24 10:07:24.228095 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 384/788] 10.222.0.26 () {60 vars in 1288 bytes} [Fri Jun 24 10:07:24 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:07:24.568710 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-674cf22a-15e7-43e8-902b-68d9c33d770e tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:24.569814 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-674cf22a-15e7-43e8-902b-68d9c33d770e tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:24.571725 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_api:SELECT=37 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:07:24.576718 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-674cf22a-15e7-43e8-902b-68d9c33d770e tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:24.577174 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-674cf22a-15e7-43e8-902b-68d9c33d770e tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:24.577984 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-674cf22a-15e7-43e8-902b-68d9c33d770e tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:24.578428 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-674cf22a-15e7-43e8-902b-68d9c33d770e tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:24.583195 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:07:24.608341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-674cf22a-15e7-43e8-902b-68d9c33d770e tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044710 Jun 24 10:07:24.609089 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 405/789] 10.222.0.26 () {58 vars in 1301 bytes} [Fri Jun 24 10:07:24 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:07:24.618894 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-12a27337-b53d-4f55-8c05-e841500ce9fc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:24.619420 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-12a27337-b53d-4f55-8c05-e841500ce9fc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:24.627130 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-12a27337-b53d-4f55-8c05-e841500ce9fc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:24.627588 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-12a27337-b53d-4f55-8c05-e841500ce9fc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:24.628388 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-12a27337-b53d-4f55-8c05-e841500ce9fc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:24.629357 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-12a27337-b53d-4f55-8c05-e841500ce9fc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:24.658184 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-12a27337-b53d-4f55-8c05-e841500ce9fc tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022/os-volume_attachments/da504a93-2d35-4f58-9d16-b6bf120ccd3f" status: 200 len: 194 microversion: 2.1 time: 0.043212 Jun 24 10:07:24.658769 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 385/790] 10.222.0.26 () {58 vars in 1412 bytes} [Fri Jun 24 10:07:24 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022/os-volume_attachments/da504a93-2d35-4f58-9d16-b6bf120ccd3f => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:07:26.302194 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-73637823-63dc-4165-ae86-145a9a5d6136 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e647f84e-cc86-4528-83d8-c7b29e28abeb"}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:07:26.303253 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-73637823-63dc-4165-ae86-145a9a5d6136 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:26.306514 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-462d4fab-4de6-4f17-8a26-ff965b5dc66d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:07:26.307087 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-462d4fab-4de6-4f17-8a26-ff965b5dc66d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:26.310892 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-73637823-63dc-4165-ae86-145a9a5d6136 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:26.311351 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-73637823-63dc-4165-ae86-145a9a5d6136 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:26.312114 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-73637823-63dc-4165-ae86-145a9a5d6136 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:26.312568 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-73637823-63dc-4165-ae86-145a9a5d6136 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:26.314295 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-462d4fab-4de6-4f17-8a26-ff965b5dc66d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:26.314781 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-462d4fab-4de6-4f17-8a26-ff965b5dc66d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:26.315554 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-462d4fab-4de6-4f17-8a26-ff965b5dc66d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:26.316018 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-462d4fab-4de6-4f17-8a26-ff965b5dc66d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:26.338334 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.objects.instance [None req-462d4fab-4de6-4f17-8a26-ff965b5dc66d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lazy-loading 'flavor' on Instance uuid 03050a70-dac3-49b8-a4ab-e73de4421841 {{(pid=124980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:07:26.980063 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-462d4fab-4de6-4f17-8a26-ff965b5dc66d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "POST /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841/action" status: 202 len: 0 microversion: 2.20 time: 0.677244 Jun 24 10:07:26.980713 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 386/791] 10.222.0.26 () {62 vars in 1318 bytes} [Fri Jun 24 10:07:26 2022] POST /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841/action => generated 0 bytes in 679 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 24 10:07:26.989341 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-98ab2d2a-54da-4388-a5ba-7c246fcaa3b3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:26.990150 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-98ab2d2a-54da-4388-a5ba-7c246fcaa3b3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:26.996545 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-98ab2d2a-54da-4388-a5ba-7c246fcaa3b3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:26.996998 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-98ab2d2a-54da-4388-a5ba-7c246fcaa3b3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:26.997770 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-98ab2d2a-54da-4388-a5ba-7c246fcaa3b3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:26.998205 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-98ab2d2a-54da-4388-a5ba-7c246fcaa3b3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:27.131593 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-98ab2d2a-54da-4388-a5ba-7c246fcaa3b3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:27.139945 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-98ab2d2a-54da-4388-a5ba-7c246fcaa3b3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:27.142085 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-98ab2d2a-54da-4388-a5ba-7c246fcaa3b3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:27.143271 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-98ab2d2a-54da-4388-a5ba-7c246fcaa3b3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1723 microversion: 2.20 time: 0.158172 Jun 24 10:07:27.143832 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 387/792] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:07:26 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:07:27.272556 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-73637823-63dc-4165-ae86-145a9a5d6136 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "POST /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.975276 Jun 24 10:07:27.273091 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 406/793] 10.222.0.26 () {60 vars in 1322 bytes} [Fri Jun 24 10:07:26 2022] POST /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022/os-volume_attachments => generated 194 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:07:28.162788 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-14ec30bb-7032-47a6-99d6-7de4d802a709 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:28.163402 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-14ec30bb-7032-47a6-99d6-7de4d802a709 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:28.170105 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-14ec30bb-7032-47a6-99d6-7de4d802a709 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:28.170554 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-14ec30bb-7032-47a6-99d6-7de4d802a709 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:28.171369 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-14ec30bb-7032-47a6-99d6-7de4d802a709 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:28.171808 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-14ec30bb-7032-47a6-99d6-7de4d802a709 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:28.308680 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-14ec30bb-7032-47a6-99d6-7de4d802a709 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:28.316473 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-14ec30bb-7032-47a6-99d6-7de4d802a709 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:28.318002 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-14ec30bb-7032-47a6-99d6-7de4d802a709 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:28.319159 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-14ec30bb-7032-47a6-99d6-7de4d802a709 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1723 microversion: 2.20 time: 0.160960 Jun 24 10:07:28.319716 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 388/794] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:07:28 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:07:29.339407 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-1784a9b6-0f01-4c3e-9773-4bd49526083f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:29.340200 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-1784a9b6-0f01-4c3e-9773-4bd49526083f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:29.346353 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1784a9b6-0f01-4c3e-9773-4bd49526083f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:29.346805 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1784a9b6-0f01-4c3e-9773-4bd49526083f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:29.347572 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1784a9b6-0f01-4c3e-9773-4bd49526083f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:29.348094 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1784a9b6-0f01-4c3e-9773-4bd49526083f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:29.476538 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-1784a9b6-0f01-4c3e-9773-4bd49526083f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:29.484594 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-1784a9b6-0f01-4c3e-9773-4bd49526083f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:29.486098 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-1784a9b6-0f01-4c3e-9773-4bd49526083f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:29.487256 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-1784a9b6-0f01-4c3e-9773-4bd49526083f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1723 microversion: 2.20 time: 0.152746 Jun 24 10:07:29.487820 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 407/795] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:07:29 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:07:30.504484 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-3c9369fe-c271-4831-ba22-46b4fd2116b7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:30.505091 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-3c9369fe-c271-4831-ba22-46b4fd2116b7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:30.511501 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3c9369fe-c271-4831-ba22-46b4fd2116b7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:30.511942 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3c9369fe-c271-4831-ba22-46b4fd2116b7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:30.512731 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3c9369fe-c271-4831-ba22-46b4fd2116b7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:30.513164 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3c9369fe-c271-4831-ba22-46b4fd2116b7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:30.515759 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:07:30.642484 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-3c9369fe-c271-4831-ba22-46b4fd2116b7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:30.651657 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-3c9369fe-c271-4831-ba22-46b4fd2116b7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:30.653170 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-3c9369fe-c271-4831-ba22-46b4fd2116b7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:30.654312 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-3c9369fe-c271-4831-ba22-46b4fd2116b7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1723 microversion: 2.20 time: 0.153785 Jun 24 10:07:30.654866 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 389/796] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:07:30 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:07:31.673662 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-ef379711-f6e0-4ceb-9b50-34d6c4486c60 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:31.674301 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-ef379711-f6e0-4ceb-9b50-34d6c4486c60 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:31.681425 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ef379711-f6e0-4ceb-9b50-34d6c4486c60 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:31.681877 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ef379711-f6e0-4ceb-9b50-34d6c4486c60 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:31.682634 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ef379711-f6e0-4ceb-9b50-34d6c4486c60 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:31.683068 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ef379711-f6e0-4ceb-9b50-34d6c4486c60 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:31.812639 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-ef379711-f6e0-4ceb-9b50-34d6c4486c60 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:31.821056 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-ef379711-f6e0-4ceb-9b50-34d6c4486c60 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:31.822547 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-ef379711-f6e0-4ceb-9b50-34d6c4486c60 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:31.823700 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-ef379711-f6e0-4ceb-9b50-34d6c4486c60 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1723 microversion: 2.20 time: 0.154248 Jun 24 10:07:31.824292 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 408/797] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:07:31 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:07:32.843055 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-a46a2a39-1718-4440-9f2d-709beb37243f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:32.843621 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-a46a2a39-1718-4440-9f2d-709beb37243f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:32.850809 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a46a2a39-1718-4440-9f2d-709beb37243f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:32.851266 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a46a2a39-1718-4440-9f2d-709beb37243f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:32.852037 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a46a2a39-1718-4440-9f2d-709beb37243f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:32.852503 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a46a2a39-1718-4440-9f2d-709beb37243f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:32.982178 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-a46a2a39-1718-4440-9f2d-709beb37243f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:32.990112 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-a46a2a39-1718-4440-9f2d-709beb37243f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:32.991621 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-a46a2a39-1718-4440-9f2d-709beb37243f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:32.992826 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-a46a2a39-1718-4440-9f2d-709beb37243f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1723 microversion: 2.20 time: 0.153695 Jun 24 10:07:32.993384 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 390/798] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:07:32 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:07:34.010886 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-0f3f6e5f-9b36-4c78-8e36-67b3d3bc86a0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:34.011439 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-0f3f6e5f-9b36-4c78-8e36-67b3d3bc86a0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:34.018228 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0f3f6e5f-9b36-4c78-8e36-67b3d3bc86a0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:34.018685 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0f3f6e5f-9b36-4c78-8e36-67b3d3bc86a0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:34.019448 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0f3f6e5f-9b36-4c78-8e36-67b3d3bc86a0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:34.019883 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0f3f6e5f-9b36-4c78-8e36-67b3d3bc86a0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:34.147593 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-0f3f6e5f-9b36-4c78-8e36-67b3d3bc86a0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:34.156598 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-0f3f6e5f-9b36-4c78-8e36-67b3d3bc86a0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:34.158109 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-0f3f6e5f-9b36-4c78-8e36-67b3d3bc86a0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:34.159317 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-0f3f6e5f-9b36-4c78-8e36-67b3d3bc86a0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1723 microversion: 2.20 time: 0.152382 Jun 24 10:07:34.159887 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 409/799] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:07:34 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:07:34.756561 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-9e6c588e-c00c-41fc-a911-3eb1e631c779 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:34.762013 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-9e6c588e-c00c-41fc-a911-3eb1e631c779 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:34.764942 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9e6c588e-c00c-41fc-a911-3eb1e631c779 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:34.765433 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9e6c588e-c00c-41fc-a911-3eb1e631c779 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:34.766195 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9e6c588e-c00c-41fc-a911-3eb1e631c779 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:34.766627 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9e6c588e-c00c-41fc-a911-3eb1e631c779 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:34.796603 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-9e6c588e-c00c-41fc-a911-3eb1e631c779 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043838 Jun 24 10:07:34.797162 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 391/800] 10.222.0.26 () {58 vars in 1301 bytes} [Fri Jun 24 10:07:34 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:07:34.935858 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-a3447a5d-84ea-4331-8b7e-faf5f4638dab tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:34.936287 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-a3447a5d-84ea-4331-8b7e-faf5f4638dab tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:34.942419 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a3447a5d-84ea-4331-8b7e-faf5f4638dab tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:34.942873 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a3447a5d-84ea-4331-8b7e-faf5f4638dab tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:34.943648 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a3447a5d-84ea-4331-8b7e-faf5f4638dab tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:34.944088 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a3447a5d-84ea-4331-8b7e-faf5f4638dab tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:34.972257 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-a3447a5d-84ea-4331-8b7e-faf5f4638dab tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022/os-volume_attachments/da504a93-2d35-4f58-9d16-b6bf120ccd3f" status: 200 len: 194 microversion: 2.1 time: 0.040404 Jun 24 10:07:34.973520 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 410/801] 10.222.0.26 () {58 vars in 1412 bytes} [Fri Jun 24 10:07:34 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022/os-volume_attachments/da504a93-2d35-4f58-9d16-b6bf120ccd3f => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:07:34.983026 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-4889bb73-b35f-4984-b7dc-f30b6631f56f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:34.983519 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-4889bb73-b35f-4984-b7dc-f30b6631f56f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:34.989399 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4889bb73-b35f-4984-b7dc-f30b6631f56f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:34.989853 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4889bb73-b35f-4984-b7dc-f30b6631f56f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:34.990602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4889bb73-b35f-4984-b7dc-f30b6631f56f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:34.991031 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4889bb73-b35f-4984-b7dc-f30b6631f56f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:35.070086 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.objects.instance [None req-4889bb73-b35f-4984-b7dc-f30b6631f56f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lazy-loading 'services' on Instance uuid 81e2c8c9-5c99-476a-a8a0-adce8022d022 {{(pid=124980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:07:35.178289 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-b3315c53-05c0-4e40-8a4b-4cd0f77a453e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:35.178906 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-b3315c53-05c0-4e40-8a4b-4cd0f77a453e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:35.185340 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b3315c53-05c0-4e40-8a4b-4cd0f77a453e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:35.185797 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b3315c53-05c0-4e40-8a4b-4cd0f77a453e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:35.186610 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b3315c53-05c0-4e40-8a4b-4cd0f77a453e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:35.187005 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b3315c53-05c0-4e40-8a4b-4cd0f77a453e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:35.281681 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-4889bb73-b35f-4984-b7dc-f30b6631f56f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "DELETE /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022/os-volume_attachments/da504a93-2d35-4f58-9d16-b6bf120ccd3f" status: 202 len: 0 microversion: 2.1 time: 0.302288 Jun 24 10:07:35.282542 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 392/802] 10.222.0.26 () {58 vars in 1415 bytes} [Fri Jun 24 10:07:34 2022] DELETE /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022/os-volume_attachments/da504a93-2d35-4f58-9d16-b6bf120ccd3f => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:07:35.315504 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-b3315c53-05c0-4e40-8a4b-4cd0f77a453e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:35.324263 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-b3315c53-05c0-4e40-8a4b-4cd0f77a453e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:35.325772 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-b3315c53-05c0-4e40-8a4b-4cd0f77a453e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:35.326975 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-b3315c53-05c0-4e40-8a4b-4cd0f77a453e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1723 microversion: 2.20 time: 0.152594 Jun 24 10:07:35.327530 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 411/803] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:07:35 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:07:36.348535 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-0254adff-d56b-46be-91e8-5f1b36490f82 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:36.349470 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-0254adff-d56b-46be-91e8-5f1b36490f82 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:36.356231 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0254adff-d56b-46be-91e8-5f1b36490f82 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:36.356686 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0254adff-d56b-46be-91e8-5f1b36490f82 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:36.357659 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0254adff-d56b-46be-91e8-5f1b36490f82 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:36.358104 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0254adff-d56b-46be-91e8-5f1b36490f82 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:36.490818 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-0254adff-d56b-46be-91e8-5f1b36490f82 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:36.499097 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-0254adff-d56b-46be-91e8-5f1b36490f82 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:36.500629 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-0254adff-d56b-46be-91e8-5f1b36490f82 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:36.501856 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-0254adff-d56b-46be-91e8-5f1b36490f82 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1723 microversion: 2.20 time: 0.158249 Jun 24 10:07:36.502413 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 393/804] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:07:36 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:07:37.450404 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-68a8aa69-40d4-43e2-bed0-35a05da6078f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:37.451022 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-68a8aa69-40d4-43e2-bed0-35a05da6078f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:37.457688 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-68a8aa69-40d4-43e2-bed0-35a05da6078f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:37.458212 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-68a8aa69-40d4-43e2-bed0-35a05da6078f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:37.458966 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-68a8aa69-40d4-43e2-bed0-35a05da6078f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:37.459397 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-68a8aa69-40d4-43e2-bed0-35a05da6078f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:37.489971 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-68a8aa69-40d4-43e2-bed0-35a05da6078f tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022/os-volume_attachments/e647f84e-cc86-4528-83d8-c7b29e28abeb" status: 200 len: 194 microversion: 2.1 time: 0.043385 Jun 24 10:07:37.490437 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 412/805] 10.222.0.26 () {58 vars in 1412 bytes} [Fri Jun 24 10:07:37 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022/os-volume_attachments/e647f84e-cc86-4528-83d8-c7b29e28abeb => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:07:37.500155 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-03097337-e241-497d-8aeb-17b5979e7c8d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:37.501217 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-03097337-e241-497d-8aeb-17b5979e7c8d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:37.507718 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-03097337-e241-497d-8aeb-17b5979e7c8d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:37.508266 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-03097337-e241-497d-8aeb-17b5979e7c8d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:37.509028 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-03097337-e241-497d-8aeb-17b5979e7c8d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:37.509460 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-03097337-e241-497d-8aeb-17b5979e7c8d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:37.519999 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-dd171e95-0bba-4ccc-bd61-8addb04605b9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:37.521633 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-dd171e95-0bba-4ccc-bd61-8addb04605b9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:37.527173 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-dd171e95-0bba-4ccc-bd61-8addb04605b9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:37.527661 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-dd171e95-0bba-4ccc-bd61-8addb04605b9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:37.528472 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-dd171e95-0bba-4ccc-bd61-8addb04605b9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:37.528907 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-dd171e95-0bba-4ccc-bd61-8addb04605b9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:37.593315 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.objects.instance [None req-03097337-e241-497d-8aeb-17b5979e7c8d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lazy-loading 'services' on Instance uuid 81e2c8c9-5c99-476a-a8a0-adce8022d022 {{(pid=124980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:07:37.818820 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-03097337-e241-497d-8aeb-17b5979e7c8d tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "DELETE /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022/os-volume_attachments/e647f84e-cc86-4528-83d8-c7b29e28abeb" status: 202 len: 0 microversion: 2.1 time: 0.322393 Jun 24 10:07:37.819541 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 394/806] 10.222.0.26 () {58 vars in 1415 bytes} [Fri Jun 24 10:07:37 2022] DELETE /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022/os-volume_attachments/e647f84e-cc86-4528-83d8-c7b29e28abeb => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:07:37.879388 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-dd171e95-0bba-4ccc-bd61-8addb04605b9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:37.888015 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-dd171e95-0bba-4ccc-bd61-8addb04605b9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:37.889546 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-dd171e95-0bba-4ccc-bd61-8addb04605b9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:37.890953 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-dd171e95-0bba-4ccc-bd61-8addb04605b9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1723 microversion: 2.20 time: 0.374978 Jun 24 10:07:37.891533 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 413/807] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:07:37 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1723 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:07:38.910911 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-c01cfb87-e096-4130-aa90-5fae2132c3cf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:38.914241 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-c01cfb87-e096-4130-aa90-5fae2132c3cf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:38.918302 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c01cfb87-e096-4130-aa90-5fae2132c3cf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:38.918753 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c01cfb87-e096-4130-aa90-5fae2132c3cf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:38.919537 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c01cfb87-e096-4130-aa90-5fae2132c3cf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:38.919966 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c01cfb87-e096-4130-aa90-5fae2132c3cf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:38.987514 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-734318a3-be5e-4b23-afe7-c598eaab0abd tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:38.987514 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-734318a3-be5e-4b23-afe7-c598eaab0abd tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:38.989672 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-734318a3-be5e-4b23-afe7-c598eaab0abd tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:38.990117 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-734318a3-be5e-4b23-afe7-c598eaab0abd tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:38.990881 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-734318a3-be5e-4b23-afe7-c598eaab0abd tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:38.991315 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-734318a3-be5e-4b23-afe7-c598eaab0abd tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:39.019798 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-734318a3-be5e-4b23-afe7-c598eaab0abd tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042138 Jun 24 10:07:39.020390 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 414/808] 10.222.0.26 () {58 vars in 1301 bytes} [Fri Jun 24 10:07:38 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 24 10:07:39.055134 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-c01cfb87-e096-4130-aa90-5fae2132c3cf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:39.063102 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-c01cfb87-e096-4130-aa90-5fae2132c3cf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:39.064632 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-c01cfb87-e096-4130-aa90-5fae2132c3cf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:39.069019 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-c01cfb87-e096-4130-aa90-5fae2132c3cf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1744 microversion: 2.20 time: 0.159668 Jun 24 10:07:39.069019 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 395/809] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:07:38 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:07:39.123743 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-fe268da4-f816-454e-bda0-4e187362fb5e tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:39.124697 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-fe268da4-f816-454e-bda0-4e187362fb5e tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:39.130700 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fe268da4-f816-454e-bda0-4e187362fb5e tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:39.131148 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fe268da4-f816-454e-bda0-4e187362fb5e tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:39.131901 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fe268da4-f816-454e-bda0-4e187362fb5e tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:39.132364 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fe268da4-f816-454e-bda0-4e187362fb5e tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:39.159886 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-fe268da4-f816-454e-bda0-4e187362fb5e tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040005 Jun 24 10:07:39.160967 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 415/810] 10.222.0.26 () {58 vars in 1301 bytes} [Fri Jun 24 10:07:39 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 10:07:39.219925 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-70bb2a87-068b-4349-9292-857f95936e01 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:39.220454 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-70bb2a87-068b-4349-9292-857f95936e01 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:39.226914 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-70bb2a87-068b-4349-9292-857f95936e01 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:39.227372 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-70bb2a87-068b-4349-9292-857f95936e01 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:39.228159 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-70bb2a87-068b-4349-9292-857f95936e01 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:39.228607 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-70bb2a87-068b-4349-9292-857f95936e01 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:39.253351 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-70bb2a87-068b-4349-9292-857f95936e01 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Going to try to terminate instance {{(pid=124980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:07:39.520508 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-70bb2a87-068b-4349-9292-857f95936e01 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "DELETE /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022" status: 204 len: 0 microversion: 2.1 time: 0.303423 Jun 24 10:07:39.521052 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 396/811] 10.222.0.26 () {58 vars in 1238 bytes} [Fri Jun 24 10:07:39 2022] DELETE /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 10:07:39.529240 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-0327647b-4dde-406a-b7b4-c4853206d870 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:39.529851 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-0327647b-4dde-406a-b7b4-c4853206d870 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:39.536636 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0327647b-4dde-406a-b7b4-c4853206d870 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:39.537082 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0327647b-4dde-406a-b7b4-c4853206d870 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:39.539752 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0327647b-4dde-406a-b7b4-c4853206d870 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:39.539752 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0327647b-4dde-406a-b7b4-c4853206d870 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:39.665256 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-0327647b-4dde-406a-b7b4-c4853206d870 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:39.673213 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-0327647b-4dde-406a-b7b4-c4853206d870 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022" status: 200 len: 1674 microversion: 2.1 time: 0.147741 Jun 24 10:07:39.674041 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 416/812] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:07:39 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:07:40.087201 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-a3e6ee47-44c5-4044-aa25-f78643c19106 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:40.088697 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-a3e6ee47-44c5-4044-aa25-f78643c19106 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:40.095118 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a3e6ee47-44c5-4044-aa25-f78643c19106 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:40.095562 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a3e6ee47-44c5-4044-aa25-f78643c19106 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:40.096372 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a3e6ee47-44c5-4044-aa25-f78643c19106 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:40.096804 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a3e6ee47-44c5-4044-aa25-f78643c19106 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:40.229427 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-a3e6ee47-44c5-4044-aa25-f78643c19106 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:40.237343 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-a3e6ee47-44c5-4044-aa25-f78643c19106 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:40.238847 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-a3e6ee47-44c5-4044-aa25-f78643c19106 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:40.239995 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-a3e6ee47-44c5-4044-aa25-f78643c19106 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1744 microversion: 2.20 time: 0.157167 Jun 24 10:07:40.240589 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 397/813] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:07:40 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:07:40.691938 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-69602260-f9af-4081-86e1-f144626dbd32 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:40.692575 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-69602260-f9af-4081-86e1-f144626dbd32 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:40.702088 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-69602260-f9af-4081-86e1-f144626dbd32 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:40.702537 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-69602260-f9af-4081-86e1-f144626dbd32 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:40.703297 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-69602260-f9af-4081-86e1-f144626dbd32 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:40.703735 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-69602260-f9af-4081-86e1-f144626dbd32 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:40.835202 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-69602260-f9af-4081-86e1-f144626dbd32 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:40.842639 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-69602260-f9af-4081-86e1-f144626dbd32 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022" status: 200 len: 1674 microversion: 2.1 time: 0.155022 Jun 24 10:07:40.843200 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 417/814] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:07:40 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022 => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:07:41.257941 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-98356fa3-918b-4e73-ba83-d85d16180350 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:41.258585 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-98356fa3-918b-4e73-ba83-d85d16180350 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:41.265199 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-98356fa3-918b-4e73-ba83-d85d16180350 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:41.265678 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-98356fa3-918b-4e73-ba83-d85d16180350 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:41.266408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-98356fa3-918b-4e73-ba83-d85d16180350 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:41.266844 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-98356fa3-918b-4e73-ba83-d85d16180350 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:41.395450 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-98356fa3-918b-4e73-ba83-d85d16180350 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:41.403336 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-98356fa3-918b-4e73-ba83-d85d16180350 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:41.405067 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-98356fa3-918b-4e73-ba83-d85d16180350 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:41.406218 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-98356fa3-918b-4e73-ba83-d85d16180350 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1744 microversion: 2.20 time: 0.152232 Jun 24 10:07:41.406769 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 398/815] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:07:41 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:07:41.839523 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-8cbce927-fb89-44e5-937e-98b958595548 req-e250eab7-99b8-4e4e-be70-d0a3b8abf91a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03050a70-dac3-49b8-a4ab-e73de4421841", "name": "network-vif-plugged", "status": "completed", "tag": "66641946-e924-41f5-ad9f-d918c412d89d"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:07:41.849802 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-8cbce927-fb89-44e5-937e-98b958595548 req-e250eab7-99b8-4e4e-be70-d0a3b8abf91a service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:41.850622 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-8cbce927-fb89-44e5-937e-98b958595548 req-e250eab7-99b8-4e4e-be70-d0a3b8abf91a service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:41.859869 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-b444d7f7-7925-438d-910a-572eaa38e041 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:41.860857 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-b444d7f7-7925-438d-910a-572eaa38e041 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:41.868593 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b444d7f7-7925-438d-910a-572eaa38e041 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:41.871703 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b444d7f7-7925-438d-910a-572eaa38e041 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:41.871703 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b444d7f7-7925-438d-910a-572eaa38e041 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:41.871703 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b444d7f7-7925-438d-910a-572eaa38e041 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:41.878777 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-8cbce927-fb89-44e5-937e-98b958595548 req-e250eab7-99b8-4e4e-be70-d0a3b8abf91a service nova] Creating event network-vif-plugged:66641946-e924-41f5-ad9f-d918c412d89d for instance 03050a70-dac3-49b8-a4ab-e73de4421841 on hv-cinder-84327 Jun 24 10:07:41.884871 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-8cbce927-fb89-44e5-937e-98b958595548 req-e250eab7-99b8-4e4e-be70-d0a3b8abf91a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049710 Jun 24 10:07:41.885853 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 418/816] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:07:42.077269 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-b444d7f7-7925-438d-910a-572eaa38e041 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:42.086179 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-b444d7f7-7925-438d-910a-572eaa38e041 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022" status: 200 len: 1674 microversion: 2.1 time: 0.231150 Jun 24 10:07:42.087665 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 399/817] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:07:41 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022 => generated 1674 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:07:42.426134 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-e8b1f0a9-fc6f-49b0-b910-1678eeb1f628 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:42.427134 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-e8b1f0a9-fc6f-49b0-b910-1678eeb1f628 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:42.433647 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e8b1f0a9-fc6f-49b0-b910-1678eeb1f628 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:42.434372 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e8b1f0a9-fc6f-49b0-b910-1678eeb1f628 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:42.435300 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e8b1f0a9-fc6f-49b0-b910-1678eeb1f628 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:42.435886 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e8b1f0a9-fc6f-49b0-b910-1678eeb1f628 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:42.638064 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-15399e9f-3ad2-4452-8f78-a45cfce370eb req-a34fec79-1309-434a-ab17-8c1d6c4414cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81e2c8c9-5c99-476a-a8a0-adce8022d022", "name": "network-vif-deleted", "tag": "8729f211-3e97-49aa-abcb-f42c379588c6"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:07:42.638453 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-e8b1f0a9-fc6f-49b0-b910-1678eeb1f628 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:42.644208 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-e8b1f0a9-fc6f-49b0-b910-1678eeb1f628 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:42.645249 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-15399e9f-3ad2-4452-8f78-a45cfce370eb req-a34fec79-1309-434a-ab17-8c1d6c4414cb service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:42.645808 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-15399e9f-3ad2-4452-8f78-a45cfce370eb req-a34fec79-1309-434a-ab17-8c1d6c4414cb service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:42.645940 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-e8b1f0a9-fc6f-49b0-b910-1678eeb1f628 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:42.647202 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-e8b1f0a9-fc6f-49b0-b910-1678eeb1f628 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1739 microversion: 2.20 time: 0.225755 Jun 24 10:07:42.660194 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 419/818] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:07:42 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:07:42.667232 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-15399e9f-3ad2-4452-8f78-a45cfce370eb req-a34fec79-1309-434a-ab17-8c1d6c4414cb service nova] Creating event network-vif-deleted:8729f211-3e97-49aa-abcb-f42c379588c6 for instance 81e2c8c9-5c99-476a-a8a0-adce8022d022 on hv-cinder-84327 Jun 24 10:07:42.674207 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-15399e9f-3ad2-4452-8f78-a45cfce370eb req-a34fec79-1309-434a-ab17-8c1d6c4414cb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053759 Jun 24 10:07:42.675424 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 400/819] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:07:43.103892 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-4e1e13e6-c7df-4c45-99cf-0249d1742803 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:43.105156 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-4e1e13e6-c7df-4c45-99cf-0249d1742803 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:43.112192 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4e1e13e6-c7df-4c45-99cf-0249d1742803 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:43.112656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4e1e13e6-c7df-4c45-99cf-0249d1742803 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:43.114037 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4e1e13e6-c7df-4c45-99cf-0249d1742803 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:43.114479 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4e1e13e6-c7df-4c45-99cf-0249d1742803 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:43.148890 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4e1e13e6-c7df-4c45-99cf-0249d1742803 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:43.149595 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4e1e13e6-c7df-4c45-99cf-0249d1742803 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:43.150214 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.objects.instance [None req-4e1e13e6-c7df-4c45-99cf-0249d1742803 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lazy-loading 'fault' on Instance uuid 81e2c8c9-5c99-476a-a8a0-adce8022d022 {{(pid=124979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:07:43.199169 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-4e1e13e6-c7df-4c45-99cf-0249d1742803 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d6654cd5c54c0294cbe1e2a1204c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b57a965c8ac24ad383260d621813bc3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:43.201564 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:07:43.212911 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-4e1e13e6-c7df-4c45-99cf-0249d1742803 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022" status: 200 len: 1328 microversion: 2.1 time: 0.107819 Jun 24 10:07:43.212911 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 420/820] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:07:43 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022 => generated 1328 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:07:43.667194 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-5a7ed133-4c69-4e88-867c-c9e5220f353d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:43.667887 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-5a7ed133-4c69-4e88-867c-c9e5220f353d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:43.676619 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5a7ed133-4c69-4e88-867c-c9e5220f353d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:43.677478 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5a7ed133-4c69-4e88-867c-c9e5220f353d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:43.680072 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5a7ed133-4c69-4e88-867c-c9e5220f353d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:43.680790 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5a7ed133-4c69-4e88-867c-c9e5220f353d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:43.856171 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-5a7ed133-4c69-4e88-867c-c9e5220f353d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:43.865844 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-5a7ed133-4c69-4e88-867c-c9e5220f353d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:43.868077 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-5a7ed133-4c69-4e88-867c-c9e5220f353d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:43.870846 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-5a7ed133-4c69-4e88-867c-c9e5220f353d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1739 microversion: 2.20 time: 0.208308 Jun 24 10:07:43.871420 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 401/821] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:07:43 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:07:44.226273 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-03179cdb-764f-4d2b-ab51-eb58e1ca0700 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:44.227111 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-03179cdb-764f-4d2b-ab51-eb58e1ca0700 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:44.234638 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-03179cdb-764f-4d2b-ab51-eb58e1ca0700 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:44.235201 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-03179cdb-764f-4d2b-ab51-eb58e1ca0700 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:44.236065 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-03179cdb-764f-4d2b-ab51-eb58e1ca0700 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:44.236613 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-03179cdb-764f-4d2b-ab51-eb58e1ca0700 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:44.254640 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-03179cdb-764f-4d2b-ab51-eb58e1ca0700 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] HTTP exception thrown: Instance 81e2c8c9-5c99-476a-a8a0-adce8022d022 could not be found. Jun 24 10:07:44.256442 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-03179cdb-764f-4d2b-ab51-eb58e1ca0700 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Request method failure captured: Jun 24 10:07:44.256442 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022 HTTP/1.1 Jun 24 10:07:44.256442 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:07:44.256442 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:07:44.256442 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:07:44.256442 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 0 Jun 24 10:07:44.256442 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:07:44.256442 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:07:44.256442 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:07:44.256442 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:07:44.256442 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitYtksazN-0In_4Z9pNARGm41_SvfSYzVIiQMHJgKhqCbnebvahtLlP0-HneeOsfVxLqDg-MT5G7A-g6l_qhpaLGWizq3WI5bFsGLC5PGQ4JDM3GWIqNO5WqFaMxQyMPbuDVj7_PyhN0KR03YRoZjozC67hqTDUwI9GNtIMmAYgPPZBY Jun 24 10:07:44.256442 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:07:44.256442 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:07:44.256442 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:07:44.256442 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:07:44.256442 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:07:44.256442 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:07:44.256442 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: b57a965c8ac24ad383260d621813bc3b Jun 24 10:07:44.256442 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-AttachVolumeTestJSON-1075129304 Jun 24 10:07:44.256442 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:07:44.256442 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:07:44.258098 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b57a965c8ac24ad383260d621813bc3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b57a965c8ac24ad383260d621813bc3b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b57a965c8ac24ad383260d621813bc3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b57a965c8ac24ad383260d621813bc3b"}]}] Jun 24 10:07:44.258098 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-AttachVolumeTestJSON-1075129304 Jun 24 10:07:44.258098 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: b57a965c8ac24ad383260d621813bc3b Jun 24 10:07:44.258098 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1075129304 Jun 24 10:07:44.258098 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-AttachVolumeTestJSON-1075129304-project Jun 24 10:07:44.258098 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:07:44.258098 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:07:44.258098 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: b9d6654cd5c54c0294cbe1e2a1204c76 Jun 24 10:07:44.258098 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-AttachVolumeTestJSON-1075129304-project Jun 24 10:07:44.258098 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: > Jun 24 10:07:44.258098 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Instance 81e2c8c9-5c99-476a-a8a0-adce8022d022 could not be found. Jun 24 10:07:44.258098 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'id': '81e2c8c9-5c99-476a-a8a0-adce8022d022'} Jun 24 10:07:44.259030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:07:44.259030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:07:44.259030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:07:44.259030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:07:44.259030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:07:44.259030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:07:44.259030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:07:44.259030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:07:44.259030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:07:44.259030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:07:44.259030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81e2c8c9-5c99-476a-a8a0-adce8022d022 could not be found. Jun 24 10:07:44.259030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:07:44.259030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:07:44.259030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:07:44.259030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:07:44.259030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:07:44.259030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:07:44.259030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:07:44.259030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:07:44.259030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:07:44.260385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:07:44.260385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:07:44.260385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:07:44.260385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:07:44.260385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:07:44.260385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:07:44.260385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:07:44.260385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81e2c8c9-5c99-476a-a8a0-adce8022d022 could not be found. Jun 24 10:07:44.260385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:07:44.260385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:07:44.260385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:07:44.260385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:07:44.260385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:07:44.260385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:07:44.260385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:07:44.260385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:07:44.260385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81e2c8c9-5c99-476a-a8a0-adce8022d022 could not be found. Jun 24 10:07:44.260385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:07:44.262931 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-03179cdb-764f-4d2b-ab51-eb58e1ca0700 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Returning 404 to user: Instance 81e2c8c9-5c99-476a-a8a0-adce8022d022 could not be found. {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:07:44.265771 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-03179cdb-764f-4d2b-ab51-eb58e1ca0700 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022" status: 404 len: 111 microversion: 2.1 time: 0.045678 Jun 24 10:07:44.266846 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 421/822] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:07:44 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:07:44.275755 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-a6108c9b-42da-4808-80e7-da7be8140586 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '.version_select at 0x7f03099790d0>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:44.317135 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-dd672299-8ad1-4d03-a639-c5b2276b193a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:44.317669 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-dd672299-8ad1-4d03-a639-c5b2276b193a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:44.325118 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-dd672299-8ad1-4d03-a639-c5b2276b193a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:44.325570 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-dd672299-8ad1-4d03-a639-c5b2276b193a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:44.326493 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-dd672299-8ad1-4d03-a639-c5b2276b193a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:44.326930 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-dd672299-8ad1-4d03-a639-c5b2276b193a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:44.355939 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-dd672299-8ad1-4d03-a639-c5b2276b193a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487/ips" status: 200 len: 150 microversion: 2.1 time: 0.043149 Jun 24 10:07:44.357151 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 422/823] 10.222.0.26 () {58 vars in 1247 bytes} [Fri Jun 24 10:07:44 2022] GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:07:44.365875 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-a6108c9b-42da-4808-80e7-da7be8140586 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1173426337" status: 202 len: 0 microversion: 2.1 time: 0.093395 Jun 24 10:07:44.369424 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 402/824] 10.222.0.26 () {58 vars in 1220 bytes} [Fri Jun 24 10:07:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1173426337 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:07:44.891158 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-9d72d64e-bb72-4d38-a0a7-7944d4a43bc0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:44.891787 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-9d72d64e-bb72-4d38-a0a7-7944d4a43bc0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:44.898466 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9d72d64e-bb72-4d38-a0a7-7944d4a43bc0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:44.899209 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9d72d64e-bb72-4d38-a0a7-7944d4a43bc0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:44.900209 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9d72d64e-bb72-4d38-a0a7-7944d4a43bc0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:44.900813 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9d72d64e-bb72-4d38-a0a7-7944d4a43bc0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:45.060761 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-9d72d64e-bb72-4d38-a0a7-7944d4a43bc0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:45.069946 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-9d72d64e-bb72-4d38-a0a7-7944d4a43bc0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:45.071487 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-9d72d64e-bb72-4d38-a0a7-7944d4a43bc0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:45.072805 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-9d72d64e-bb72-4d38-a0a7-7944d4a43bc0 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1739 microversion: 2.20 time: 0.185957 Jun 24 10:07:45.073919 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 423/825] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:07:44 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:07:46.092747 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-0c52e87e-8d17-46a8-842b-632afbbfadde tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:46.094087 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-0c52e87e-8d17-46a8-842b-632afbbfadde tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:46.102626 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0c52e87e-8d17-46a8-842b-632afbbfadde tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:46.103077 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0c52e87e-8d17-46a8-842b-632afbbfadde tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:46.103857 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0c52e87e-8d17-46a8-842b-632afbbfadde tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:46.104445 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0c52e87e-8d17-46a8-842b-632afbbfadde tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:46.250813 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-0c52e87e-8d17-46a8-842b-632afbbfadde tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:46.264040 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-c2c0ffda-f271-46ab-9ec3-fb8fb4f118d1 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9642563-bbed-4a43-8fdd-040832474021"}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:07:46.266036 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-c2c0ffda-f271-46ab-9ec3-fb8fb4f118d1 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:46.272942 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-0c52e87e-8d17-46a8-842b-632afbbfadde tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:46.274476 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-0c52e87e-8d17-46a8-842b-632afbbfadde tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:46.275631 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-0c52e87e-8d17-46a8-842b-632afbbfadde tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1739 microversion: 2.20 time: 0.187740 Jun 24 10:07:46.276200 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 403/826] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:07:46 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:07:46.279845 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c2c0ffda-f271-46ab-9ec3-fb8fb4f118d1 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:46.280570 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c2c0ffda-f271-46ab-9ec3-fb8fb4f118d1 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:46.282409 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c2c0ffda-f271-46ab-9ec3-fb8fb4f118d1 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:46.283207 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c2c0ffda-f271-46ab-9ec3-fb8fb4f118d1 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:47.092719 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-c2c0ffda-f271-46ab-9ec3-fb8fb4f118d1 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "POST /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.834044 Jun 24 10:07:47.098418 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 424/827] 10.222.0.26 () {60 vars in 1322 bytes} [Fri Jun 24 10:07:46 2022] POST /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487/os-volume_attachments => generated 194 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:07:47.293617 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-d6e428c0-4382-43d4-bd1a-c41efdb48c3c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:47.296056 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-d6e428c0-4382-43d4-bd1a-c41efdb48c3c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:47.303575 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d6e428c0-4382-43d4-bd1a-c41efdb48c3c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:47.313636 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d6e428c0-4382-43d4-bd1a-c41efdb48c3c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:47.314929 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d6e428c0-4382-43d4-bd1a-c41efdb48c3c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:47.315780 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d6e428c0-4382-43d4-bd1a-c41efdb48c3c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:47.350695 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:07:47.495094 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d6e428c0-4382-43d4-bd1a-c41efdb48c3c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:47.505292 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d6e428c0-4382-43d4-bd1a-c41efdb48c3c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:47.506896 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d6e428c0-4382-43d4-bd1a-c41efdb48c3c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:47.508189 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-d6e428c0-4382-43d4-bd1a-c41efdb48c3c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1739 microversion: 2.20 time: 0.218767 Jun 24 10:07:47.509064 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 404/828] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:07:47 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1739 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:07:48.266120 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-36be0c95-6661-4eb5-ad01-7a88c4587970 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:48.266690 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-36be0c95-6661-4eb5-ad01-7a88c4587970 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:48.272875 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-36be0c95-6661-4eb5-ad01-7a88c4587970 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:48.273320 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-36be0c95-6661-4eb5-ad01-7a88c4587970 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:48.274072 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-36be0c95-6661-4eb5-ad01-7a88c4587970 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:48.274502 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-36be0c95-6661-4eb5-ad01-7a88c4587970 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:48.288279 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-36be0c95-6661-4eb5-ad01-7a88c4587970 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] HTTP exception thrown: Instance 81e2c8c9-5c99-476a-a8a0-adce8022d022 could not be found. Jun 24 10:07:48.289933 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-36be0c95-6661-4eb5-ad01-7a88c4587970 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Request method failure captured: Jun 24 10:07:48.289933 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: DELETE /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022 HTTP/1.1 Jun 24 10:07:48.289933 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:07:48.289933 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:07:48.289933 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:07:48.289933 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 0 Jun 24 10:07:48.289933 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:07:48.289933 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:07:48.289933 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:07:48.289933 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:07:48.289933 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitYtksazN-0In_4Z9pNARGm41_SvfSYzVIiQMHJgKhqCbnebvahtLlP0-HneeOsfVxLqDg-MT5G7A-g6l_qhpaLGWizq3WI5bFsGLC5PGQ4JDM3GWIqNO5WqFaMxQyMPbuDVj7_PyhN0KR03YRoZjozC67hqTDUwI9GNtIMmAYgPPZBY Jun 24 10:07:48.289933 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:07:48.289933 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:07:48.289933 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:07:48.289933 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:07:48.289933 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:07:48.289933 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:07:48.289933 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: b57a965c8ac24ad383260d621813bc3b Jun 24 10:07:48.289933 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-AttachVolumeTestJSON-1075129304 Jun 24 10:07:48.289933 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:07:48.289933 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:07:48.291321 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b57a965c8ac24ad383260d621813bc3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b57a965c8ac24ad383260d621813bc3b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b57a965c8ac24ad383260d621813bc3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b57a965c8ac24ad383260d621813bc3b"}]}] Jun 24 10:07:48.291321 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-AttachVolumeTestJSON-1075129304 Jun 24 10:07:48.291321 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: b57a965c8ac24ad383260d621813bc3b Jun 24 10:07:48.291321 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1075129304 Jun 24 10:07:48.291321 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-AttachVolumeTestJSON-1075129304-project Jun 24 10:07:48.291321 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:07:48.291321 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:07:48.291321 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: b9d6654cd5c54c0294cbe1e2a1204c76 Jun 24 10:07:48.291321 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-AttachVolumeTestJSON-1075129304-project Jun 24 10:07:48.291321 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: > Jun 24 10:07:48.291321 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Instance 81e2c8c9-5c99-476a-a8a0-adce8022d022 could not be found. Jun 24 10:07:48.291321 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'id': '81e2c8c9-5c99-476a-a8a0-adce8022d022'} Jun 24 10:07:48.292049 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:07:48.292049 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:07:48.292049 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:07:48.292049 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:07:48.292049 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:07:48.292049 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:07:48.292049 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:07:48.292049 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:07:48.292049 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:07:48.292049 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:07:48.292049 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81e2c8c9-5c99-476a-a8a0-adce8022d022 could not be found. Jun 24 10:07:48.292049 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:07:48.292049 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:07:48.292049 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:07:48.292049 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:07:48.292049 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:07:48.292049 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:07:48.292049 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:07:48.292049 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:07:48.292049 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:07:48.293297 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:07:48.293297 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 10:07:48.293297 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 10:07:48.293297 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 10:07:48.293297 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 10:07:48.293297 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:07:48.293297 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:07:48.293297 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:07:48.293297 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:07:48.293297 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81e2c8c9-5c99-476a-a8a0-adce8022d022 could not be found. Jun 24 10:07:48.293297 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:07:48.293297 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:07:48.293297 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:07:48.293297 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:07:48.293297 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:07:48.293297 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:07:48.293297 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:07:48.293297 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:07:48.293297 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81e2c8c9-5c99-476a-a8a0-adce8022d022 could not be found. Jun 24 10:07:48.293297 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:07:48.294518 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-36be0c95-6661-4eb5-ad01-7a88c4587970 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Returning 404 to user: Instance 81e2c8c9-5c99-476a-a8a0-adce8022d022 could not be found. {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:07:48.294518 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-36be0c95-6661-4eb5-ad01-7a88c4587970 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "DELETE /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022" status: 404 len: 111 microversion: 2.1 time: 0.030066 Jun 24 10:07:48.294518 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 425/829] 10.222.0.26 () {58 vars in 1238 bytes} [Fri Jun 24 10:07:48 2022] DELETE /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:07:48.301278 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-9e58b21b-3cff-45d3-9b1f-d23f2b06b230 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:48.301794 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-9e58b21b-3cff-45d3-9b1f-d23f2b06b230 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 81e2c8c9-5c99-476a-a8a0-adce8022d022] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:48.308732 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9e58b21b-3cff-45d3-9b1f-d23f2b06b230 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:48.309186 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9e58b21b-3cff-45d3-9b1f-d23f2b06b230 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:48.309959 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9e58b21b-3cff-45d3-9b1f-d23f2b06b230 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:48.310410 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9e58b21b-3cff-45d3-9b1f-d23f2b06b230 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:48.323503 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.wsgi [None req-9e58b21b-3cff-45d3-9b1f-d23f2b06b230 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] HTTP exception thrown: Instance 81e2c8c9-5c99-476a-a8a0-adce8022d022 could not be found. Jun 24 10:07:48.325152 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-9e58b21b-3cff-45d3-9b1f-d23f2b06b230 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Request method failure captured: Jun 24 10:07:48.325152 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: request: GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022 HTTP/1.1 Jun 24 10:07:48.325152 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept: application/json Jun 24 10:07:48.325152 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept-Encoding: identity Jun 24 10:07:48.325152 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Connection: close Jun 24 10:07:48.325152 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Length: 0 Jun 24 10:07:48.325152 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Type: application/json Jun 24 10:07:48.325152 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Host: 10.222.0.26 Jun 24 10:07:48.325152 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Openstack-System-Scope: None Jun 24 10:07:48.325152 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: User-Agent: python-urllib3/1.26.9 Jun 24 10:07:48.325152 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Auth-Token: gAAAAABitYtksazN-0In_4Z9pNARGm41_SvfSYzVIiQMHJgKhqCbnebvahtLlP0-HneeOsfVxLqDg-MT5G7A-g6l_qhpaLGWizq3WI5bFsGLC5PGQ4JDM3GWIqNO5WqFaMxQyMPbuDVj7_PyhN0KR03YRoZjozC67hqTDUwI9GNtIMmAYgPPZBY Jun 24 10:07:48.325152 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Id: None Jun 24 10:07:48.325152 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Name: None Jun 24 10:07:48.325152 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Identity-Status: Confirmed Jun 24 10:07:48.325152 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Is-Admin-Project: True Jun 24 10:07:48.325152 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Id: default Jun 24 10:07:48.325152 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Name: Default Jun 24 10:07:48.325152 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Id: b57a965c8ac24ad383260d621813bc3b Jun 24 10:07:48.325152 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Name: tempest-AttachVolumeTestJSON-1075129304 Jun 24 10:07:48.325152 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Role: reader,member Jun 24 10:07:48.325152 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Roles: reader,member Jun 24 10:07:48.365318 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b57a965c8ac24ad383260d621813bc3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b57a965c8ac24ad383260d621813bc3b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b57a965c8ac24ad383260d621813bc3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b57a965c8ac24ad383260d621813bc3b"}]}] Jun 24 10:07:48.365318 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant: tempest-AttachVolumeTestJSON-1075129304 Jun 24 10:07:48.365318 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Id: b57a965c8ac24ad383260d621813bc3b Jun 24 10:07:48.365318 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1075129304 Jun 24 10:07:48.365318 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User: tempest-AttachVolumeTestJSON-1075129304-project Jun 24 10:07:48.365318 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Id: default Jun 24 10:07:48.365318 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Name: Default Jun 24 10:07:48.365318 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Id: b9d6654cd5c54c0294cbe1e2a1204c76 Jun 24 10:07:48.365318 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Name: tempest-AttachVolumeTestJSON-1075129304-project Jun 24 10:07:48.365318 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: method: > Jun 24 10:07:48.365318 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: exception: Instance 81e2c8c9-5c99-476a-a8a0-adce8022d022 could not be found. Jun 24 10:07:48.365318 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: action_args: {'id': '81e2c8c9-5c99-476a-a8a0-adce8022d022'} Jun 24 10:07:48.366250 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:07:48.366250 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:07:48.366250 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:07:48.366250 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:07:48.366250 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:07:48.366250 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:07:48.366250 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:07:48.366250 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:07:48.366250 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:07:48.366250 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:07:48.366250 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81e2c8c9-5c99-476a-a8a0-adce8022d022 could not be found. Jun 24 10:07:48.366250 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:07:48.366250 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:07:48.366250 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:07:48.366250 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:07:48.366250 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:07:48.366250 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:07:48.366250 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:07:48.366250 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:07:48.366250 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:07:48.367798 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:07:48.367798 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:07:48.367798 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:07:48.367798 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:07:48.367798 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:07:48.367798 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:07:48.367798 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:07:48.367798 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81e2c8c9-5c99-476a-a8a0-adce8022d022 could not be found. Jun 24 10:07:48.367798 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:07:48.367798 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:07:48.367798 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:07:48.367798 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:07:48.367798 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:07:48.367798 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:07:48.367798 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:07:48.367798 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:07:48.367798 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81e2c8c9-5c99-476a-a8a0-adce8022d022 could not be found. Jun 24 10:07:48.367798 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:07:48.369148 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-9e58b21b-3cff-45d3-9b1f-d23f2b06b230 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Returning 404 to user: Instance 81e2c8c9-5c99-476a-a8a0-adce8022d022 could not be found. {{(pid=124980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:07:48.369148 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-9e58b21b-3cff-45d3-9b1f-d23f2b06b230 tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022" status: 404 len: 111 microversion: 2.1 time: 0.030177 Jun 24 10:07:48.369148 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 405/830] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:07:48 2022] GET /compute/v2.1/servers/81e2c8c9-5c99-476a-a8a0-adce8022d022 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:07:48.526948 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-2c6647a1-c02a-45cb-8877-53f912b40f96 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:48.527468 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-2c6647a1-c02a-45cb-8877-53f912b40f96 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:48.533689 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2c6647a1-c02a-45cb-8877-53f912b40f96 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:48.534178 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2c6647a1-c02a-45cb-8877-53f912b40f96 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:48.535513 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2c6647a1-c02a-45cb-8877-53f912b40f96 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:48.535995 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2c6647a1-c02a-45cb-8877-53f912b40f96 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:48.671783 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-2c6647a1-c02a-45cb-8877-53f912b40f96 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:48.687358 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-2c6647a1-c02a-45cb-8877-53f912b40f96 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:48.688972 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-2c6647a1-c02a-45cb-8877-53f912b40f96 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:48.690094 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-2c6647a1-c02a-45cb-8877-53f912b40f96 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1739 microversion: 2.20 time: 0.167139 Jun 24 10:07:48.690686 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 426/831] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:07:48 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:07:49.711168 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-0b8f44c9-dba2-40c6-8883-88ce17e15762 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:49.711779 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-0b8f44c9-dba2-40c6-8883-88ce17e15762 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:49.719031 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0b8f44c9-dba2-40c6-8883-88ce17e15762 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:49.719567 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0b8f44c9-dba2-40c6-8883-88ce17e15762 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:49.720482 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0b8f44c9-dba2-40c6-8883-88ce17e15762 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:49.721148 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0b8f44c9-dba2-40c6-8883-88ce17e15762 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:49.782788 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-ba78d5c6-406e-4c4f-b4f7-7117708f1bde tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:49.784007 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-ba78d5c6-406e-4c4f-b4f7-7117708f1bde tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:49.792535 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ba78d5c6-406e-4c4f-b4f7-7117708f1bde tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:49.793524 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ba78d5c6-406e-4c4f-b4f7-7117708f1bde tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:49.794540 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ba78d5c6-406e-4c4f-b4f7-7117708f1bde tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:49.795190 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ba78d5c6-406e-4c4f-b4f7-7117708f1bde tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:49.812826 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-ba78d5c6-406e-4c4f-b4f7-7117708f1bde tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] HTTP exception thrown: Instance 84bc600e-1c87-4ba3-9dfa-421ee774e45e could not be found. Jun 24 10:07:49.814530 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-ba78d5c6-406e-4c4f-b4f7-7117708f1bde tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Request method failure captured: Jun 24 10:07:49.814530 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: DELETE /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e HTTP/1.1 Jun 24 10:07:49.814530 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:07:49.814530 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:07:49.814530 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:07:49.814530 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 0 Jun 24 10:07:49.814530 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:07:49.814530 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:07:49.814530 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:07:49.814530 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:07:49.814530 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitYtksazN-0In_4Z9pNARGm41_SvfSYzVIiQMHJgKhqCbnebvahtLlP0-HneeOsfVxLqDg-MT5G7A-g6l_qhpaLGWizq3WI5bFsGLC5PGQ4JDM3GWIqNO5WqFaMxQyMPbuDVj7_PyhN0KR03YRoZjozC67hqTDUwI9GNtIMmAYgPPZBY Jun 24 10:07:49.814530 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:07:49.814530 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:07:49.814530 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:07:49.814530 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:07:49.814530 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:07:49.814530 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:07:49.814530 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: b57a965c8ac24ad383260d621813bc3b Jun 24 10:07:49.814530 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-AttachVolumeTestJSON-1075129304 Jun 24 10:07:49.814530 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:07:49.814530 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:07:49.821754 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b57a965c8ac24ad383260d621813bc3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b57a965c8ac24ad383260d621813bc3b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b57a965c8ac24ad383260d621813bc3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b57a965c8ac24ad383260d621813bc3b"}]}] Jun 24 10:07:49.821754 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-AttachVolumeTestJSON-1075129304 Jun 24 10:07:49.821754 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: b57a965c8ac24ad383260d621813bc3b Jun 24 10:07:49.821754 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1075129304 Jun 24 10:07:49.821754 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-AttachVolumeTestJSON-1075129304-project Jun 24 10:07:49.821754 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:07:49.821754 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:07:49.821754 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: b9d6654cd5c54c0294cbe1e2a1204c76 Jun 24 10:07:49.821754 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-AttachVolumeTestJSON-1075129304-project Jun 24 10:07:49.821754 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: > Jun 24 10:07:49.821754 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Instance 84bc600e-1c87-4ba3-9dfa-421ee774e45e could not be found. Jun 24 10:07:49.821754 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'id': '84bc600e-1c87-4ba3-9dfa-421ee774e45e'} Jun 24 10:07:49.822590 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:07:49.822590 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:07:49.822590 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:07:49.822590 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:07:49.822590 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:07:49.822590 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:07:49.822590 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:07:49.822590 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:07:49.822590 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:07:49.822590 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:07:49.822590 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84bc600e-1c87-4ba3-9dfa-421ee774e45e could not be found. Jun 24 10:07:49.822590 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:07:49.822590 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:07:49.822590 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:07:49.822590 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:07:49.822590 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:07:49.822590 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:07:49.822590 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:07:49.822590 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:07:49.822590 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:07:49.824059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:07:49.824059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 10:07:49.824059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 10:07:49.824059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 10:07:49.824059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 10:07:49.824059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:07:49.824059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:07:49.824059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:07:49.824059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:07:49.824059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84bc600e-1c87-4ba3-9dfa-421ee774e45e could not be found. Jun 24 10:07:49.824059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:07:49.824059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:07:49.824059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:07:49.824059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:07:49.824059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:07:49.824059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:07:49.824059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:07:49.824059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:07:49.824059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84bc600e-1c87-4ba3-9dfa-421ee774e45e could not be found. Jun 24 10:07:49.824059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:07:49.825528 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-ba78d5c6-406e-4c4f-b4f7-7117708f1bde tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Returning 404 to user: Instance 84bc600e-1c87-4ba3-9dfa-421ee774e45e could not be found. {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:07:49.825528 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-ba78d5c6-406e-4c4f-b4f7-7117708f1bde tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "DELETE /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 404 len: 111 microversion: 2.1 time: 0.038210 Jun 24 10:07:49.825528 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 427/832] 10.222.0.26 () {58 vars in 1238 bytes} [Fri Jun 24 10:07:49 2022] DELETE /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:07:49.831058 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-f75148ed-af34-4a39-9483-ecbf7fdabc0e tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:49.832374 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-f75148ed-af34-4a39-9483-ecbf7fdabc0e tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] [instance: 84bc600e-1c87-4ba3-9dfa-421ee774e45e] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:49.839364 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f75148ed-af34-4a39-9483-ecbf7fdabc0e tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:49.839959 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f75148ed-af34-4a39-9483-ecbf7fdabc0e tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:49.841079 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f75148ed-af34-4a39-9483-ecbf7fdabc0e tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:49.841690 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f75148ed-af34-4a39-9483-ecbf7fdabc0e tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:49.860073 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-f75148ed-af34-4a39-9483-ecbf7fdabc0e tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] HTTP exception thrown: Instance 84bc600e-1c87-4ba3-9dfa-421ee774e45e could not be found. Jun 24 10:07:49.862141 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-f75148ed-af34-4a39-9483-ecbf7fdabc0e tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Request method failure captured: Jun 24 10:07:49.862141 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e HTTP/1.1 Jun 24 10:07:49.862141 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:07:49.862141 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:07:49.862141 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:07:49.862141 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 0 Jun 24 10:07:49.862141 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:07:49.862141 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:07:49.862141 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:07:49.862141 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:07:49.862141 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitYtksazN-0In_4Z9pNARGm41_SvfSYzVIiQMHJgKhqCbnebvahtLlP0-HneeOsfVxLqDg-MT5G7A-g6l_qhpaLGWizq3WI5bFsGLC5PGQ4JDM3GWIqNO5WqFaMxQyMPbuDVj7_PyhN0KR03YRoZjozC67hqTDUwI9GNtIMmAYgPPZBY Jun 24 10:07:49.862141 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:07:49.862141 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:07:49.862141 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:07:49.862141 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:07:49.862141 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:07:49.862141 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:07:49.862141 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: b57a965c8ac24ad383260d621813bc3b Jun 24 10:07:49.862141 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-AttachVolumeTestJSON-1075129304 Jun 24 10:07:49.862141 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:07:49.862141 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:07:49.863667 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b57a965c8ac24ad383260d621813bc3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b57a965c8ac24ad383260d621813bc3b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b57a965c8ac24ad383260d621813bc3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b57a965c8ac24ad383260d621813bc3b"}]}] Jun 24 10:07:49.863667 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-AttachVolumeTestJSON-1075129304 Jun 24 10:07:49.863667 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: b57a965c8ac24ad383260d621813bc3b Jun 24 10:07:49.863667 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1075129304 Jun 24 10:07:49.863667 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-AttachVolumeTestJSON-1075129304-project Jun 24 10:07:49.863667 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:07:49.863667 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:07:49.863667 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: b9d6654cd5c54c0294cbe1e2a1204c76 Jun 24 10:07:49.863667 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-AttachVolumeTestJSON-1075129304-project Jun 24 10:07:49.863667 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: > Jun 24 10:07:49.863667 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Instance 84bc600e-1c87-4ba3-9dfa-421ee774e45e could not be found. Jun 24 10:07:49.863667 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'id': '84bc600e-1c87-4ba3-9dfa-421ee774e45e'} Jun 24 10:07:49.867428 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:07:49.867428 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:07:49.867428 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:07:49.867428 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:07:49.867428 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:07:49.867428 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:07:49.867428 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:07:49.867428 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:07:49.867428 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:07:49.867428 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:07:49.867428 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84bc600e-1c87-4ba3-9dfa-421ee774e45e could not be found. Jun 24 10:07:49.867428 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:07:49.867428 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:07:49.867428 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:07:49.867428 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:07:49.867428 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:07:49.867428 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:07:49.867428 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:07:49.867428 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:07:49.867428 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:07:49.868737 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:07:49.868737 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:07:49.868737 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:07:49.868737 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:07:49.868737 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:07:49.868737 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:07:49.868737 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:07:49.868737 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84bc600e-1c87-4ba3-9dfa-421ee774e45e could not be found. Jun 24 10:07:49.868737 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:07:49.868737 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:07:49.868737 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:07:49.868737 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:07:49.868737 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:07:49.868737 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:07:49.868737 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:07:49.868737 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:07:49.868737 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84bc600e-1c87-4ba3-9dfa-421ee774e45e could not be found. Jun 24 10:07:49.868737 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:07:49.869858 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-f75148ed-af34-4a39-9483-ecbf7fdabc0e tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] Returning 404 to user: Instance 84bc600e-1c87-4ba3-9dfa-421ee774e45e could not be found. {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:07:49.869858 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-f75148ed-af34-4a39-9483-ecbf7fdabc0e tempest-AttachVolumeTestJSON-1075129304 tempest-AttachVolumeTestJSON-1075129304-project] 10.222.0.26 "GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e" status: 404 len: 111 microversion: 2.1 time: 0.040686 Jun 24 10:07:49.873166 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 428/833] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:07:49 2022] GET /compute/v2.1/servers/84bc600e-1c87-4ba3-9dfa-421ee774e45e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:07:49.910925 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-0b8f44c9-dba2-40c6-8883-88ce17e15762 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:49.925246 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-0b8f44c9-dba2-40c6-8883-88ce17e15762 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:49.931204 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-0b8f44c9-dba2-40c6-8883-88ce17e15762 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:49.932458 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-0b8f44c9-dba2-40c6-8883-88ce17e15762 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1739 microversion: 2.20 time: 0.227561 Jun 24 10:07:49.933022 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 406/834] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:07:49 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:07:50.951368 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-a87769be-3d5c-4c91-b9de-084375f590ce tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:50.952015 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-a87769be-3d5c-4c91-b9de-084375f590ce tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:50.960761 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a87769be-3d5c-4c91-b9de-084375f590ce tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:50.961644 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a87769be-3d5c-4c91-b9de-084375f590ce tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:50.962607 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a87769be-3d5c-4c91-b9de-084375f590ce tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:50.963225 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a87769be-3d5c-4c91-b9de-084375f590ce tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:51.193184 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-a87769be-3d5c-4c91-b9de-084375f590ce tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:51.206650 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-a87769be-3d5c-4c91-b9de-084375f590ce tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:51.208448 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-a87769be-3d5c-4c91-b9de-084375f590ce tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:51.209871 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-a87769be-3d5c-4c91-b9de-084375f590ce tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1739 microversion: 2.20 time: 0.262941 Jun 24 10:07:51.210993 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 429/835] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:07:50 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:07:52.231015 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-8ec620be-786f-45fb-9a37-30df3e4b0b6d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:52.232394 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-8ec620be-786f-45fb-9a37-30df3e4b0b6d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:52.241538 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8ec620be-786f-45fb-9a37-30df3e4b0b6d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:52.242305 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8ec620be-786f-45fb-9a37-30df3e4b0b6d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:52.243331 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8ec620be-786f-45fb-9a37-30df3e4b0b6d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:52.244628 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8ec620be-786f-45fb-9a37-30df3e4b0b6d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:52.767478 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-8ec620be-786f-45fb-9a37-30df3e4b0b6d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:52.776241 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-8ec620be-786f-45fb-9a37-30df3e4b0b6d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:52.778993 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-8ec620be-786f-45fb-9a37-30df3e4b0b6d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:52.779292 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-8ec620be-786f-45fb-9a37-30df3e4b0b6d tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1739 microversion: 2.20 time: 0.552064 Jun 24 10:07:52.779852 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 407/836] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:07:52 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1739 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:07:53.798040 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-6bc1a7ce-3191-4ac0-adeb-c8c32f71ce66 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:53.799484 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-6bc1a7ce-3191-4ac0-adeb-c8c32f71ce66 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:53.806543 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6bc1a7ce-3191-4ac0-adeb-c8c32f71ce66 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:53.807018 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6bc1a7ce-3191-4ac0-adeb-c8c32f71ce66 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:53.807789 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6bc1a7ce-3191-4ac0-adeb-c8c32f71ce66 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:53.808266 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6bc1a7ce-3191-4ac0-adeb-c8c32f71ce66 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:53.940404 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-6bc1a7ce-3191-4ac0-adeb-c8c32f71ce66 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:53.949249 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-6bc1a7ce-3191-4ac0-adeb-c8c32f71ce66 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:53.950764 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-6bc1a7ce-3191-4ac0-adeb-c8c32f71ce66 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:53.955433 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-6bc1a7ce-3191-4ac0-adeb-c8c32f71ce66 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1721 microversion: 2.20 time: 0.157973 Jun 24 10:07:53.955433 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 430/837] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:07:53 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:07:54.663462 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-c8678bff-b0bf-4eaf-b866-e701dc7a16e6 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Action: 'create', calling method: .version_select at 0x7f03099999d0>, body: {"keypair": {"name": "tempest-keypair-1883686950", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVuQrbed0yrp2urGyfIN99w481scxOGt70kFdnY32AKW1KQZZiMQ6EfK0x7rLav9c6DYPgc8/uwjjuQKsrusx4PfwGyFE7ZNHsdQayUM+iUfYsuN8qNL8dlgtiR6dl8uQ=="}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:07:54.677977 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-c8678bff-b0bf-4eaf-b866-e701dc7a16e6 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Getting quotas for project 64b655c9ef0948c099f60649b9d5e78d. Resources: {'key_pairs'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:07:54.681753 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-c8678bff-b0bf-4eaf-b866-e701dc7a16e6 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Getting quotas for user f2c97e68f66142f9b502b215313f7e80 and project 64b655c9ef0948c099f60649b9d5e78d. Resources: {'key_pairs'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:07:54.797665 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-c8678bff-b0bf-4eaf-b866-e701dc7a16e6 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.138717 Jun 24 10:07:54.798306 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 408/838] 10.222.0.26 () {60 vars in 1158 bytes} [Fri Jun 24 10:07:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:07:54.971049 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-3a3fab8f-d341-4517-ba2b-5d2908009b51 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:54.972149 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-3a3fab8f-d341-4517-ba2b-5d2908009b51 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:54.978840 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3a3fab8f-d341-4517-ba2b-5d2908009b51 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:54.979290 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3a3fab8f-d341-4517-ba2b-5d2908009b51 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:54.980058 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3a3fab8f-d341-4517-ba2b-5d2908009b51 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:54.980520 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3a3fab8f-d341-4517-ba2b-5d2908009b51 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:55.116785 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-3a3fab8f-d341-4517-ba2b-5d2908009b51 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:55.130744 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-3a3fab8f-d341-4517-ba2b-5d2908009b51 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:55.133524 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-3a3fab8f-d341-4517-ba2b-5d2908009b51 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:55.134761 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-3a3fab8f-d341-4517-ba2b-5d2908009b51 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1721 microversion: 2.20 time: 0.167907 Jun 24 10:07:55.135500 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 431/839] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:07:54 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:07:56.153879 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-6b1eb664-dd26-4d2d-beb3-308c13fe6888 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:56.154614 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-6b1eb664-dd26-4d2d-beb3-308c13fe6888 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:56.161324 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6b1eb664-dd26-4d2d-beb3-308c13fe6888 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:56.161776 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6b1eb664-dd26-4d2d-beb3-308c13fe6888 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:56.162549 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6b1eb664-dd26-4d2d-beb3-308c13fe6888 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:56.162993 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6b1eb664-dd26-4d2d-beb3-308c13fe6888 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:56.385352 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-6b1eb664-dd26-4d2d-beb3-308c13fe6888 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:56.394536 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-6b1eb664-dd26-4d2d-beb3-308c13fe6888 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:56.396430 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-6b1eb664-dd26-4d2d-beb3-308c13fe6888 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:56.397879 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-6b1eb664-dd26-4d2d-beb3-308c13fe6888 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1721 microversion: 2.20 time: 0.248504 Jun 24 10:07:56.399168 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 409/840] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:07:56 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1721 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:07:57.416789 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-6c9ad7d2-a509-4758-8d23-373c23a78966 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:57.417385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-6c9ad7d2-a509-4758-8d23-373c23a78966 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:57.419837 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_api:SELECT=56 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:07:57.425754 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6c9ad7d2-a509-4758-8d23-373c23a78966 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:57.426103 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6c9ad7d2-a509-4758-8d23-373c23a78966 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:57.426870 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6c9ad7d2-a509-4758-8d23-373c23a78966 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:57.427438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6c9ad7d2-a509-4758-8d23-373c23a78966 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:57.555396 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-207fc387-732c-4400-9250-5b151d7a0997 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-462040640", "imageRef": "f6b1dddb-2953-41a2-99e3-00aeca441bd9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c1a62ba-de23-4693-a76a-ab88e859eb34"}], "security_groups": [{"name": "tempest-securitygroup--581129693"}], "key_name": "tempest-keypair-1883686950", "user_data": "}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:07:57.562452 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:07:57.578269 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-6c9ad7d2-a509-4758-8d23-373c23a78966 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:57.587066 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-6c9ad7d2-a509-4758-8d23-373c23a78966 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:57.588957 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-6c9ad7d2-a509-4758-8d23-373c23a78966 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:57.590350 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-6c9ad7d2-a509-4758-8d23-373c23a78966 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1664 microversion: 2.20 time: 0.177552 Jun 24 10:07:57.591074 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 432/841] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:07:57 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1664 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:07:57.608922 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-a7d76214-33e2-41f3-8737-665205b0889f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aea2c0f3-7a0a-4a2a-b900-8087fe28a89c"}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:07:57.609605 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-a7d76214-33e2-41f3-8737-665205b0889f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:57.623103 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a7d76214-33e2-41f3-8737-665205b0889f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:57.623103 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a7d76214-33e2-41f3-8737-665205b0889f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:57.623103 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a7d76214-33e2-41f3-8737-665205b0889f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:57.623103 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a7d76214-33e2-41f3-8737-665205b0889f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:57.684552 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.network.neutron [None req-207fc387-732c-4400-9250-5b151d7a0997 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] validate_networks() for [('2c1a62ba-de23-4693-a76a-ab88e859eb34', None, None, None, None, None)] {{(pid=124980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:07:58.194455 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-207fc387-732c-4400-9250-5b151d7a0997 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Flavor limits 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:07:58.194888 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-207fc387-732c-4400-9250-5b151d7a0997 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Image limits 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:07:58.195370 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-207fc387-732c-4400-9250-5b151d7a0997 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Flavor pref 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:07:58.195785 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-207fc387-732c-4400-9250-5b151d7a0997 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Image pref 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:07:58.196260 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-207fc387-732c-4400-9250-5b151d7a0997 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:07:58.205383 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-207fc387-732c-4400-9250-5b151d7a0997 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:58.210594 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-207fc387-732c-4400-9250-5b151d7a0997 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:58.210594 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-207fc387-732c-4400-9250-5b151d7a0997 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:58.210594 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-207fc387-732c-4400-9250-5b151d7a0997 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:58.223644 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-207fc387-732c-4400-9250-5b151d7a0997 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Getting quotas for project 64b655c9ef0948c099f60649b9d5e78d. Resources: {'instances', 'cores', 'ram'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:07:58.227588 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-207fc387-732c-4400-9250-5b151d7a0997 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Getting quotas for user f2c97e68f66142f9b502b215313f7e80 and project 64b655c9ef0948c099f60649b9d5e78d. Resources: {'instances', 'cores', 'ram'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:07:58.239310 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-207fc387-732c-4400-9250-5b151d7a0997 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Going to run 1 instances... {{(pid=124980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:07:58.241617 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-207fc387-732c-4400-9250-5b151d7a0997 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6b1dddb-2953-41a2-99e3-00aeca441bd9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:07:58.402237 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-207fc387-732c-4400-9250-5b151d7a0997 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.852228 Jun 24 10:07:58.403124 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 410/842] 10.222.0.26 () {60 vars in 1146 bytes} [Fri Jun 24 10:07:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 10:07:58.412641 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-7c1188a5-7972-4863-b394-b8b79ee7b05c req-7c9bfae8-8032-42b9-af1a-0dafdc118250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03050a70-dac3-49b8-a4ab-e73de4421841", "name": "network-vif-unplugged", "status": "completed", "tag": "66641946-e924-41f5-ad9f-d918c412d89d"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:07:58.423833 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-7c1188a5-7972-4863-b394-b8b79ee7b05c req-7c9bfae8-8032-42b9-af1a-0dafdc118250 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:58.424686 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-7c1188a5-7972-4863-b394-b8b79ee7b05c req-7c9bfae8-8032-42b9-af1a-0dafdc118250 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:58.442135 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.compute.server_external_events [req-7c1188a5-7972-4863-b394-b8b79ee7b05c req-7c9bfae8-8032-42b9-af1a-0dafdc118250 service nova] Unable to find a host for instance 03050a70-dac3-49b8-a4ab-e73de4421841. Dropping event network-vif-unplugged {{(pid=124980) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 24 10:07:58.443101 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-7c1188a5-7972-4863-b394-b8b79ee7b05c req-7c9bfae8-8032-42b9-af1a-0dafdc118250 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034407 Jun 24 10:07:58.444058 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 411/843] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 24 10:07:58.449021 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-1437d75f-e4b1-4969-82fe-0ebe939762f3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:58.449384 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-1437d75f-e4b1-4969-82fe-0ebe939762f3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:58.527559 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-1437d75f-e4b1-4969-82fe-0ebe939762f3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:58.538090 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-1437d75f-e4b1-4969-82fe-0ebe939762f3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9" status: 200 len: 1241 microversion: 2.1 time: 0.092840 Jun 24 10:07:58.539250 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 412/844] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:07:58 2022] GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 => generated 1241 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:07:58.794618 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-a7d76214-33e2-41f3-8737-665205b0889f tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "POST /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.189807 Jun 24 10:07:58.795346 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 433/845] 10.222.0.26 () {62 vars in 1363 bytes} [Fri Jun 24 10:07:57 2022] POST /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841/os-volume_attachments => generated 188 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 10:07:58.915556 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-dade6493-349f-498c-9bf0-a30932387478 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:58.916056 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-dade6493-349f-498c-9bf0-a30932387478 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:58.923159 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-dade6493-349f-498c-9bf0-a30932387478 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:58.923615 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-dade6493-349f-498c-9bf0-a30932387478 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:58.924654 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-dade6493-349f-498c-9bf0-a30932387478 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:58.925110 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-dade6493-349f-498c-9bf0-a30932387478 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:59.555509 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-7efa2cac-c594-4796-b3ac-f97c64e5afc4 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:59.556217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-7efa2cac-c594-4796-b3ac-f97c64e5afc4 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:59.563233 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7efa2cac-c594-4796-b3ac-f97c64e5afc4 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:59.563677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7efa2cac-c594-4796-b3ac-f97c64e5afc4 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:59.564461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7efa2cac-c594-4796-b3ac-f97c64e5afc4 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:59.564895 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7efa2cac-c594-4796-b3ac-f97c64e5afc4 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:59.589949 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-dade6493-349f-498c-9bf0-a30932387478 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "DELETE /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841/os-volume_attachments/aea2c0f3-7a0a-4a2a-b900-8087fe28a89c" status: 202 len: 0 microversion: 2.20 time: 0.678328 Jun 24 10:07:59.590555 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 413/846] 10.222.0.26 () {60 vars in 1456 bytes} [Fri Jun 24 10:07:58 2022] DELETE /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841/os-volume_attachments/aea2c0f3-7a0a-4a2a-b900-8087fe28a89c => generated 0 bytes in 680 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:07:59.627852 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-7efa2cac-c594-4796-b3ac-f97c64e5afc4 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:07:59.634928 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-7efa2cac-c594-4796-b3ac-f97c64e5afc4 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9" status: 200 len: 1245 microversion: 2.1 time: 0.083139 Jun 24 10:07:59.635498 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 434/847] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:07:59 2022] GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:07:59.658076 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-8623291c-cb6e-4356-999e-4998b0c82de9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:07:59.658650 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-8623291c-cb6e-4356-999e-4998b0c82de9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:59.664692 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8623291c-cb6e-4356-999e-4998b0c82de9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:59.667899 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8623291c-cb6e-4356-999e-4998b0c82de9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:59.667899 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8623291c-cb6e-4356-999e-4998b0c82de9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:59.667899 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8623291c-cb6e-4356-999e-4998b0c82de9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:59.862342 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-8623291c-cb6e-4356-999e-4998b0c82de9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "POST /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841/action" status: 202 len: 0 microversion: 2.20 time: 0.207908 Jun 24 10:07:59.866631 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 414/848] 10.222.0.26 () {62 vars in 1318 bytes} [Fri Jun 24 10:07:59 2022] POST /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:07:59.871922 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-72e66488-9aa5-4491-8470-30ed83d4b835 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:59.873183 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-72e66488-9aa5-4491-8470-30ed83d4b835 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:07:59.880597 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-72e66488-9aa5-4491-8470-30ed83d4b835 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:59.885197 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-72e66488-9aa5-4491-8470-30ed83d4b835 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:59.885197 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-72e66488-9aa5-4491-8470-30ed83d4b835 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:59.885197 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-72e66488-9aa5-4491-8470-30ed83d4b835 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:00.026859 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-72e66488-9aa5-4491-8470-30ed83d4b835 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:00.035540 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-72e66488-9aa5-4491-8470-30ed83d4b835 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:00.038836 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-72e66488-9aa5-4491-8470-30ed83d4b835 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:00.038836 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-72e66488-9aa5-4491-8470-30ed83d4b835 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1672 microversion: 2.20 time: 0.170336 Jun 24 10:08:00.038836 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 435/849] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:07:59 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1672 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:08:00.653166 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-b0ab3233-d520-48f1-8ed0-3f6f4578ecd8 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:00.654541 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-b0ab3233-d520-48f1-8ed0-3f6f4578ecd8 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:00.663346 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b0ab3233-d520-48f1-8ed0-3f6f4578ecd8 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:00.664221 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b0ab3233-d520-48f1-8ed0-3f6f4578ecd8 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:00.665210 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b0ab3233-d520-48f1-8ed0-3f6f4578ecd8 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:00.665819 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b0ab3233-d520-48f1-8ed0-3f6f4578ecd8 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:00.779132 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-b0ab3233-d520-48f1-8ed0-3f6f4578ecd8 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:00.818085 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-b0ab3233-d520-48f1-8ed0-3f6f4578ecd8 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9" status: 200 len: 1301 microversion: 2.1 time: 0.169886 Jun 24 10:08:00.822475 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 415/850] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:08:00 2022] GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 => generated 1301 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:08:01.057022 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-59fb642a-1328-4d75-8991-8a86ed423de3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:01.057708 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-59fb642a-1328-4d75-8991-8a86ed423de3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:01.067647 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-59fb642a-1328-4d75-8991-8a86ed423de3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:01.068111 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-59fb642a-1328-4d75-8991-8a86ed423de3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:01.068923 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-59fb642a-1328-4d75-8991-8a86ed423de3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:01.069378 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-59fb642a-1328-4d75-8991-8a86ed423de3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:01.096434 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:08:01.244626 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-59fb642a-1328-4d75-8991-8a86ed423de3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:01.252943 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-59fb642a-1328-4d75-8991-8a86ed423de3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:01.255220 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-59fb642a-1328-4d75-8991-8a86ed423de3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:01.257385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-59fb642a-1328-4d75-8991-8a86ed423de3 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1672 microversion: 2.20 time: 0.204242 Jun 24 10:08:01.258434 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 436/851] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:08:01 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1672 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:08:01.835670 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-6cfedc80-088e-4c76-84a0-2130c5e59e7d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:01.837149 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-6cfedc80-088e-4c76-84a0-2130c5e59e7d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:01.844311 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6cfedc80-088e-4c76-84a0-2130c5e59e7d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:01.845015 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6cfedc80-088e-4c76-84a0-2130c5e59e7d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:01.845970 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6cfedc80-088e-4c76-84a0-2130c5e59e7d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:01.846408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6cfedc80-088e-4c76-84a0-2130c5e59e7d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:02.045283 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-6cfedc80-088e-4c76-84a0-2130c5e59e7d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:02.053336 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-6cfedc80-088e-4c76-84a0-2130c5e59e7d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9" status: 200 len: 1366 microversion: 2.1 time: 0.221985 Jun 24 10:08:02.053910 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 416/852] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:08:01 2022] GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:08:02.276727 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-e014ded8-6848-45fe-be8f-8fc6455d5a49 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:02.277343 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-e014ded8-6848-45fe-be8f-8fc6455d5a49 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:02.285808 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e014ded8-6848-45fe-be8f-8fc6455d5a49 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:02.297783 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e014ded8-6848-45fe-be8f-8fc6455d5a49 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:02.297783 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e014ded8-6848-45fe-be8f-8fc6455d5a49 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:02.297783 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e014ded8-6848-45fe-be8f-8fc6455d5a49 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:02.441265 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-e014ded8-6848-45fe-be8f-8fc6455d5a49 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:02.449586 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-e014ded8-6848-45fe-be8f-8fc6455d5a49 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:02.451999 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-e014ded8-6848-45fe-be8f-8fc6455d5a49 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:02.453209 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-e014ded8-6848-45fe-be8f-8fc6455d5a49 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1730 microversion: 2.20 time: 0.180416 Jun 24 10:08:02.453765 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 437/853] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:08:02 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:08:02.586285 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-3b93d320-d96d-4d2f-a211-eed8bfb5eab2 req-b0c8b0cd-9d19-45f5-a09d-97232886ab84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f866b577-5318-4708-a475-c7121b57d3e9", "tag": "bac3a226-ee26-4181-b090-f29884ba1887"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:08:02.598685 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-3b93d320-d96d-4d2f-a211-eed8bfb5eab2 req-b0c8b0cd-9d19-45f5-a09d-97232886ab84 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:02.599481 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-3b93d320-d96d-4d2f-a211-eed8bfb5eab2 req-b0c8b0cd-9d19-45f5-a09d-97232886ab84 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:02.614915 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-3b93d320-d96d-4d2f-a211-eed8bfb5eab2 req-b0c8b0cd-9d19-45f5-a09d-97232886ab84 service nova] Creating event network-changed:bac3a226-ee26-4181-b090-f29884ba1887 for instance f866b577-5318-4708-a475-c7121b57d3e9 on hv-cinder-84327 Jun 24 10:08:02.626172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-3b93d320-d96d-4d2f-a211-eed8bfb5eab2 req-b0c8b0cd-9d19-45f5-a09d-97232886ab84 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043055 Jun 24 10:08:02.627736 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 417/854] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:08:03.071369 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-2d65f073-76c8-4132-ad9f-5573e04c15dd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:03.074111 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-2d65f073-76c8-4132-ad9f-5573e04c15dd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:03.079313 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2d65f073-76c8-4132-ad9f-5573e04c15dd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:03.079758 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2d65f073-76c8-4132-ad9f-5573e04c15dd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:03.080560 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2d65f073-76c8-4132-ad9f-5573e04c15dd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:03.080993 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2d65f073-76c8-4132-ad9f-5573e04c15dd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:03.219562 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-2d65f073-76c8-4132-ad9f-5573e04c15dd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:03.227061 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-2d65f073-76c8-4132-ad9f-5573e04c15dd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9" status: 200 len: 1366 microversion: 2.1 time: 0.159917 Jun 24 10:08:03.227614 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 438/855] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:08:03 2022] GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:08:03.472954 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-032ab11c-737e-4ae1-bdac-a546f2e96111 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:03.473817 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-032ab11c-737e-4ae1-bdac-a546f2e96111 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:03.479967 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-032ab11c-737e-4ae1-bdac-a546f2e96111 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:03.480635 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-032ab11c-737e-4ae1-bdac-a546f2e96111 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:03.481411 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-032ab11c-737e-4ae1-bdac-a546f2e96111 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:03.481847 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-032ab11c-737e-4ae1-bdac-a546f2e96111 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:03.783603 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-032ab11c-737e-4ae1-bdac-a546f2e96111 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:03.798846 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-032ab11c-737e-4ae1-bdac-a546f2e96111 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:03.802980 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-032ab11c-737e-4ae1-bdac-a546f2e96111 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:03.805196 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-032ab11c-737e-4ae1-bdac-a546f2e96111 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1730 microversion: 2.20 time: 0.336779 Jun 24 10:08:03.810481 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 418/856] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:08:03 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1730 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:08:04.243571 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-16f2c7bb-9ff6-4407-a503-5292f5a9ab32 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:04.244231 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-16f2c7bb-9ff6-4407-a503-5292f5a9ab32 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:04.250796 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-16f2c7bb-9ff6-4407-a503-5292f5a9ab32 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:04.251243 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-16f2c7bb-9ff6-4407-a503-5292f5a9ab32 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:04.252010 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-16f2c7bb-9ff6-4407-a503-5292f5a9ab32 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:04.252485 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-16f2c7bb-9ff6-4407-a503-5292f5a9ab32 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:04.387758 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-16f2c7bb-9ff6-4407-a503-5292f5a9ab32 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:04.403866 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-16f2c7bb-9ff6-4407-a503-5292f5a9ab32 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9" status: 200 len: 1366 microversion: 2.1 time: 0.164051 Jun 24 10:08:04.404935 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 439/857] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:08:04 2022] GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:08:04.824533 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-4b8e47df-f135-457c-9bb1-930cb3e69f14 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:04.825151 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-4b8e47df-f135-457c-9bb1-930cb3e69f14 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:04.832459 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4b8e47df-f135-457c-9bb1-930cb3e69f14 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:04.832911 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4b8e47df-f135-457c-9bb1-930cb3e69f14 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:04.833673 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4b8e47df-f135-457c-9bb1-930cb3e69f14 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:04.834109 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4b8e47df-f135-457c-9bb1-930cb3e69f14 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:04.979153 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-4b8e47df-f135-457c-9bb1-930cb3e69f14 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:04.989206 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-4b8e47df-f135-457c-9bb1-930cb3e69f14 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:04.990750 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-4b8e47df-f135-457c-9bb1-930cb3e69f14 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:04.991952 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-4b8e47df-f135-457c-9bb1-930cb3e69f14 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1730 microversion: 2.20 time: 0.171301 Jun 24 10:08:04.992547 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 419/858] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:08:04 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:08:05.421836 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-99eb73b9-ff0e-4e50-a96e-843680d80d7f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:05.423029 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-99eb73b9-ff0e-4e50-a96e-843680d80d7f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:05.436245 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-99eb73b9-ff0e-4e50-a96e-843680d80d7f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:05.438223 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-99eb73b9-ff0e-4e50-a96e-843680d80d7f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:05.438223 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-99eb73b9-ff0e-4e50-a96e-843680d80d7f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:05.438645 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-99eb73b9-ff0e-4e50-a96e-843680d80d7f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:05.627917 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-99eb73b9-ff0e-4e50-a96e-843680d80d7f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:05.636494 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-99eb73b9-ff0e-4e50-a96e-843680d80d7f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9" status: 200 len: 1366 microversion: 2.1 time: 0.218670 Jun 24 10:08:05.637064 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 440/859] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:08:05 2022] GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:08:06.010783 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-3f02e85a-e0bb-4bd1-baa1-25d7dda45745 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:06.011666 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-3f02e85a-e0bb-4bd1-baa1-25d7dda45745 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:06.017961 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3f02e85a-e0bb-4bd1-baa1-25d7dda45745 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:06.018418 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3f02e85a-e0bb-4bd1-baa1-25d7dda45745 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:06.019357 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3f02e85a-e0bb-4bd1-baa1-25d7dda45745 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:06.019798 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3f02e85a-e0bb-4bd1-baa1-25d7dda45745 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:06.147899 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-3f02e85a-e0bb-4bd1-baa1-25d7dda45745 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:06.155832 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-3f02e85a-e0bb-4bd1-baa1-25d7dda45745 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:06.160629 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-3f02e85a-e0bb-4bd1-baa1-25d7dda45745 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:06.160629 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-3f02e85a-e0bb-4bd1-baa1-25d7dda45745 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1730 microversion: 2.20 time: 0.151746 Jun 24 10:08:06.160629 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 420/860] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:08:06 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:08:06.655816 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-d95a8af0-39e4-4f13-ac31-6b9b5e905c34 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:06.657725 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-d95a8af0-39e4-4f13-ac31-6b9b5e905c34 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:06.667322 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d95a8af0-39e4-4f13-ac31-6b9b5e905c34 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:06.667776 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d95a8af0-39e4-4f13-ac31-6b9b5e905c34 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:06.668735 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d95a8af0-39e4-4f13-ac31-6b9b5e905c34 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:06.669176 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d95a8af0-39e4-4f13-ac31-6b9b5e905c34 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:07.069288 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d95a8af0-39e4-4f13-ac31-6b9b5e905c34 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:07.075158 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-d95a8af0-39e4-4f13-ac31-6b9b5e905c34 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9" status: 200 len: 1366 microversion: 2.1 time: 0.425086 Jun 24 10:08:07.075936 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 441/861] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:08:06 2022] GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 => generated 1366 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:08:07.178633 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-2fedc5bd-2d04-4124-9c57-68f2285a026a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:07.179194 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-2fedc5bd-2d04-4124-9c57-68f2285a026a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:07.186002 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2fedc5bd-2d04-4124-9c57-68f2285a026a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:07.186445 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2fedc5bd-2d04-4124-9c57-68f2285a026a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:07.187412 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2fedc5bd-2d04-4124-9c57-68f2285a026a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:07.188006 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2fedc5bd-2d04-4124-9c57-68f2285a026a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:07.386185 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2fedc5bd-2d04-4124-9c57-68f2285a026a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:07.394362 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2fedc5bd-2d04-4124-9c57-68f2285a026a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:07.395873 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2fedc5bd-2d04-4124-9c57-68f2285a026a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:07.397056 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-2fedc5bd-2d04-4124-9c57-68f2285a026a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1730 microversion: 2.20 time: 0.223382 Jun 24 10:08:07.397619 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 421/862] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:08:07 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1730 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:08:08.092822 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-235b3358-09eb-4eb3-b50d-580e25e3c9fd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:08.093527 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-235b3358-09eb-4eb3-b50d-580e25e3c9fd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:08.101250 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-235b3358-09eb-4eb3-b50d-580e25e3c9fd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:08.101779 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-235b3358-09eb-4eb3-b50d-580e25e3c9fd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:08.102632 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-235b3358-09eb-4eb3-b50d-580e25e3c9fd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:08.103273 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-235b3358-09eb-4eb3-b50d-580e25e3c9fd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:08.240876 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-235b3358-09eb-4eb3-b50d-580e25e3c9fd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:08.248790 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-235b3358-09eb-4eb3-b50d-580e25e3c9fd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9" status: 200 len: 1366 microversion: 2.1 time: 0.159841 Jun 24 10:08:08.249415 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 442/863] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:08:08 2022] GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:08:08.417923 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-4ed44449-a886-4faf-b6ff-0f963eb9080b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:08.418574 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-4ed44449-a886-4faf-b6ff-0f963eb9080b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:08.422953 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell0:SELECT=2 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:08:08.431298 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4ed44449-a886-4faf-b6ff-0f963eb9080b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:08.432000 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4ed44449-a886-4faf-b6ff-0f963eb9080b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:08.432912 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4ed44449-a886-4faf-b6ff-0f963eb9080b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:08.433466 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4ed44449-a886-4faf-b6ff-0f963eb9080b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:08.438190 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:08:08.533545 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell0:SELECT=12 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:08:08.607704 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-4ed44449-a886-4faf-b6ff-0f963eb9080b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:08.616874 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-4ed44449-a886-4faf-b6ff-0f963eb9080b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:08.618443 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-4ed44449-a886-4faf-b6ff-0f963eb9080b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:08.620756 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-4ed44449-a886-4faf-b6ff-0f963eb9080b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1730 microversion: 2.20 time: 0.207745 Jun 24 10:08:08.621835 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 422/864] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:08:08 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1730 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:08:09.266348 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-9187d4a4-c46a-4920-b38d-188dad8a1cf3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:09.267572 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-9187d4a4-c46a-4920-b38d-188dad8a1cf3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:09.280807 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9187d4a4-c46a-4920-b38d-188dad8a1cf3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:09.281265 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9187d4a4-c46a-4920-b38d-188dad8a1cf3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:09.282064 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9187d4a4-c46a-4920-b38d-188dad8a1cf3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:09.282506 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9187d4a4-c46a-4920-b38d-188dad8a1cf3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:09.428303 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-9187d4a4-c46a-4920-b38d-188dad8a1cf3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:09.435172 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-9187d4a4-c46a-4920-b38d-188dad8a1cf3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9" status: 200 len: 1366 microversion: 2.1 time: 0.173235 Jun 24 10:08:09.435936 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 443/865] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:08:09 2022] GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:08:09.639610 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-1e212000-c318-4931-988f-b7ef260f207c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:09.640415 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-1e212000-c318-4931-988f-b7ef260f207c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:09.647360 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1e212000-c318-4931-988f-b7ef260f207c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:09.647796 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1e212000-c318-4931-988f-b7ef260f207c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:09.648596 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1e212000-c318-4931-988f-b7ef260f207c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:09.649030 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1e212000-c318-4931-988f-b7ef260f207c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:09.791741 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-1e212000-c318-4931-988f-b7ef260f207c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:09.801997 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-1e212000-c318-4931-988f-b7ef260f207c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:09.803658 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-1e212000-c318-4931-988f-b7ef260f207c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:09.805755 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-1e212000-c318-4931-988f-b7ef260f207c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1730 microversion: 2.20 time: 0.170587 Jun 24 10:08:09.816884 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 423/866] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:08:09 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:08:10.095646 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-45ef9108-cea8-4472-9fc5-0fd22e8d9042 req-d3c5442b-6d7b-4458-8397-f5987e6cca02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f866b577-5318-4708-a475-c7121b57d3e9", "name": "network-vif-plugged", "status": "completed", "tag": "bac3a226-ee26-4181-b090-f29884ba1887"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:08:10.104861 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-45ef9108-cea8-4472-9fc5-0fd22e8d9042 req-d3c5442b-6d7b-4458-8397-f5987e6cca02 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:10.105299 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-45ef9108-cea8-4472-9fc5-0fd22e8d9042 req-d3c5442b-6d7b-4458-8397-f5987e6cca02 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:10.117214 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-45ef9108-cea8-4472-9fc5-0fd22e8d9042 req-d3c5442b-6d7b-4458-8397-f5987e6cca02 service nova] Creating event network-vif-plugged:bac3a226-ee26-4181-b090-f29884ba1887 for instance f866b577-5318-4708-a475-c7121b57d3e9 on hv-cinder-84327 Jun 24 10:08:10.122570 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-45ef9108-cea8-4472-9fc5-0fd22e8d9042 req-d3c5442b-6d7b-4458-8397-f5987e6cca02 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030665 Jun 24 10:08:10.123370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 444/867] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:08:10.452672 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-e74f2826-85d8-4a08-871f-05bf111484a8 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:10.453278 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-e74f2826-85d8-4a08-871f-05bf111484a8 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:10.459732 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e74f2826-85d8-4a08-871f-05bf111484a8 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:10.460203 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e74f2826-85d8-4a08-871f-05bf111484a8 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:10.460960 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e74f2826-85d8-4a08-871f-05bf111484a8 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:10.461392 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e74f2826-85d8-4a08-871f-05bf111484a8 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:10.597958 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-e74f2826-85d8-4a08-871f-05bf111484a8 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:10.605851 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-e74f2826-85d8-4a08-871f-05bf111484a8 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9" status: 200 len: 1366 microversion: 2.1 time: 0.156854 Jun 24 10:08:10.606499 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 424/868] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:08:10 2022] GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:08:10.825696 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-59770ed0-92f1-4948-8479-bb5d2c6fac3c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:10.826395 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-59770ed0-92f1-4948-8479-bb5d2c6fac3c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:10.833581 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-59770ed0-92f1-4948-8479-bb5d2c6fac3c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:10.834052 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-59770ed0-92f1-4948-8479-bb5d2c6fac3c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:10.834818 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-59770ed0-92f1-4948-8479-bb5d2c6fac3c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:10.835250 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-59770ed0-92f1-4948-8479-bb5d2c6fac3c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:10.977485 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-59770ed0-92f1-4948-8479-bb5d2c6fac3c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:10.990734 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-59770ed0-92f1-4948-8479-bb5d2c6fac3c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:10.992694 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-59770ed0-92f1-4948-8479-bb5d2c6fac3c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:10.994137 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-59770ed0-92f1-4948-8479-bb5d2c6fac3c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1730 microversion: 2.20 time: 0.173151 Jun 24 10:08:10.994868 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 445/869] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:08:10 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:08:11.622208 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-c1db83ad-2a84-4fe4-9285-245236c7ce23 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:11.622830 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-c1db83ad-2a84-4fe4-9285-245236c7ce23 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:11.630108 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c1db83ad-2a84-4fe4-9285-245236c7ce23 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:11.630711 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c1db83ad-2a84-4fe4-9285-245236c7ce23 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:11.631354 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c1db83ad-2a84-4fe4-9285-245236c7ce23 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:11.631791 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c1db83ad-2a84-4fe4-9285-245236c7ce23 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:11.803488 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-c1db83ad-2a84-4fe4-9285-245236c7ce23 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:11.811163 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-c1db83ad-2a84-4fe4-9285-245236c7ce23 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9" status: 200 len: 1366 microversion: 2.1 time: 0.192854 Jun 24 10:08:11.811666 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 425/870] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:08:11 2022] GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:08:12.013826 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-3bf6d8d1-6e84-49aa-a435-38e7f6b90a38 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:12.014492 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-3bf6d8d1-6e84-49aa-a435-38e7f6b90a38 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:12.024887 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3bf6d8d1-6e84-49aa-a435-38e7f6b90a38 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:12.025616 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3bf6d8d1-6e84-49aa-a435-38e7f6b90a38 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:12.026901 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3bf6d8d1-6e84-49aa-a435-38e7f6b90a38 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:12.031773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3bf6d8d1-6e84-49aa-a435-38e7f6b90a38 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:12.192522 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-3bf6d8d1-6e84-49aa-a435-38e7f6b90a38 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:12.204367 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-3bf6d8d1-6e84-49aa-a435-38e7f6b90a38 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:12.205854 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-3bf6d8d1-6e84-49aa-a435-38e7f6b90a38 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:12.207078 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-3bf6d8d1-6e84-49aa-a435-38e7f6b90a38 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1730 microversion: 2.20 time: 0.198073 Jun 24 10:08:12.207645 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 446/871] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:08:12 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1730 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:08:12.834290 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-a0c2502a-41ea-4365-8e6b-d8e54a4dac95 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:12.834934 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-a0c2502a-41ea-4365-8e6b-d8e54a4dac95 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:12.841805 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a0c2502a-41ea-4365-8e6b-d8e54a4dac95 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:12.842656 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a0c2502a-41ea-4365-8e6b-d8e54a4dac95 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:12.843779 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a0c2502a-41ea-4365-8e6b-d8e54a4dac95 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:12.844399 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a0c2502a-41ea-4365-8e6b-d8e54a4dac95 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:13.043207 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-a0c2502a-41ea-4365-8e6b-d8e54a4dac95 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:13.057884 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-a0c2502a-41ea-4365-8e6b-d8e54a4dac95 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9" status: 200 len: 1366 microversion: 2.1 time: 0.227136 Jun 24 10:08:13.059306 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 426/872] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:08:12 2022] GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:08:13.227781 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-b4db3e13-e5bb-4777-b2c6-81ad715729d2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:13.228970 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-b4db3e13-e5bb-4777-b2c6-81ad715729d2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:13.244107 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b4db3e13-e5bb-4777-b2c6-81ad715729d2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:13.244607 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b4db3e13-e5bb-4777-b2c6-81ad715729d2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:13.245398 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b4db3e13-e5bb-4777-b2c6-81ad715729d2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:13.245840 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b4db3e13-e5bb-4777-b2c6-81ad715729d2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:13.455455 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-b4db3e13-e5bb-4777-b2c6-81ad715729d2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:13.464715 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-b4db3e13-e5bb-4777-b2c6-81ad715729d2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:13.466702 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-b4db3e13-e5bb-4777-b2c6-81ad715729d2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:13.467938 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-b4db3e13-e5bb-4777-b2c6-81ad715729d2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1730 microversion: 2.20 time: 0.245040 Jun 24 10:08:13.477282 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 447/873] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:08:13 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1730 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:08:14.086781 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-5a1e73d6-3fc5-46c4-8d81-6917eab3d835 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:14.087583 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-5a1e73d6-3fc5-46c4-8d81-6917eab3d835 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:14.095161 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5a1e73d6-3fc5-46c4-8d81-6917eab3d835 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:14.097731 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5a1e73d6-3fc5-46c4-8d81-6917eab3d835 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:14.097731 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5a1e73d6-3fc5-46c4-8d81-6917eab3d835 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:14.097731 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5a1e73d6-3fc5-46c4-8d81-6917eab3d835 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:14.232312 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-5a1e73d6-3fc5-46c4-8d81-6917eab3d835 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:14.240870 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-5a1e73d6-3fc5-46c4-8d81-6917eab3d835 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9" status: 200 len: 1366 microversion: 2.1 time: 0.162892 Jun 24 10:08:14.243759 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 427/874] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:08:14 2022] GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:08:14.487256 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-874bf657-9b46-4c2e-846f-b69281f6775a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:14.488576 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-874bf657-9b46-4c2e-846f-b69281f6775a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:14.495058 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-874bf657-9b46-4c2e-846f-b69281f6775a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:14.495510 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-874bf657-9b46-4c2e-846f-b69281f6775a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:14.496312 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-874bf657-9b46-4c2e-846f-b69281f6775a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:14.496752 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-874bf657-9b46-4c2e-846f-b69281f6775a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:14.627602 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-874bf657-9b46-4c2e-846f-b69281f6775a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:14.635600 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-874bf657-9b46-4c2e-846f-b69281f6775a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:14.637118 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-874bf657-9b46-4c2e-846f-b69281f6775a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:14.638283 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-874bf657-9b46-4c2e-846f-b69281f6775a tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1730 microversion: 2.20 time: 0.154993 Jun 24 10:08:14.638845 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 448/875] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:08:14 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:08:15.257400 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-ee74df24-3a46-415f-96c7-66620cddad28 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:15.258034 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-ee74df24-3a46-415f-96c7-66620cddad28 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:15.264685 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ee74df24-3a46-415f-96c7-66620cddad28 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:15.265168 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ee74df24-3a46-415f-96c7-66620cddad28 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:15.265948 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ee74df24-3a46-415f-96c7-66620cddad28 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:15.266388 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ee74df24-3a46-415f-96c7-66620cddad28 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:15.417804 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-ee74df24-3a46-415f-96c7-66620cddad28 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:15.426249 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-ee74df24-3a46-415f-96c7-66620cddad28 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9" status: 200 len: 1366 microversion: 2.1 time: 0.173333 Jun 24 10:08:15.426819 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 428/876] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:08:15 2022] GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:08:15.657679 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-fd278a9a-5b65-402c-a6fc-36448d04bd48 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:15.658376 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-fd278a9a-5b65-402c-a6fc-36448d04bd48 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:15.664999 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fd278a9a-5b65-402c-a6fc-36448d04bd48 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:15.665445 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fd278a9a-5b65-402c-a6fc-36448d04bd48 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:15.666217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fd278a9a-5b65-402c-a6fc-36448d04bd48 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:15.667353 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fd278a9a-5b65-402c-a6fc-36448d04bd48 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:15.802085 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-fd278a9a-5b65-402c-a6fc-36448d04bd48 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:15.810293 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-fd278a9a-5b65-402c-a6fc-36448d04bd48 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:15.811834 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-fd278a9a-5b65-402c-a6fc-36448d04bd48 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:15.813026 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-fd278a9a-5b65-402c-a6fc-36448d04bd48 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1730 microversion: 2.20 time: 0.159464 Jun 24 10:08:15.813588 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 449/877] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:08:15 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:08:16.444411 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-601d3eda-deff-43d8-abd7-eeefdeae866f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:16.445559 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-601d3eda-deff-43d8-abd7-eeefdeae866f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:16.455131 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-601d3eda-deff-43d8-abd7-eeefdeae866f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:16.456188 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-601d3eda-deff-43d8-abd7-eeefdeae866f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:16.457178 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-601d3eda-deff-43d8-abd7-eeefdeae866f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:16.457967 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-601d3eda-deff-43d8-abd7-eeefdeae866f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:16.605173 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-601d3eda-deff-43d8-abd7-eeefdeae866f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:16.614015 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-601d3eda-deff-43d8-abd7-eeefdeae866f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9" status: 200 len: 1366 microversion: 2.1 time: 0.174920 Jun 24 10:08:16.614678 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 429/878] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:08:16 2022] GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:08:16.831932 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-f4767aec-21b1-4e2a-9a09-e43e17edf7f9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:16.832596 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-f4767aec-21b1-4e2a-9a09-e43e17edf7f9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:16.839130 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f4767aec-21b1-4e2a-9a09-e43e17edf7f9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:16.839572 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f4767aec-21b1-4e2a-9a09-e43e17edf7f9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:16.840485 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f4767aec-21b1-4e2a-9a09-e43e17edf7f9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:16.840915 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f4767aec-21b1-4e2a-9a09-e43e17edf7f9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:16.984273 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-f4767aec-21b1-4e2a-9a09-e43e17edf7f9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:16.992534 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-f4767aec-21b1-4e2a-9a09-e43e17edf7f9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:16.994151 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-f4767aec-21b1-4e2a-9a09-e43e17edf7f9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:16.995181 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-f4767aec-21b1-4e2a-9a09-e43e17edf7f9 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1730 microversion: 2.20 time: 0.167797 Jun 24 10:08:16.995726 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 450/879] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:08:16 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:08:17.630938 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-a3faaef1-ccb0-4d51-92c1-3e00b62d2ded tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:17.631559 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-a3faaef1-ccb0-4d51-92c1-3e00b62d2ded tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:17.637737 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a3faaef1-ccb0-4d51-92c1-3e00b62d2ded tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:17.638252 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a3faaef1-ccb0-4d51-92c1-3e00b62d2ded tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:17.639023 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a3faaef1-ccb0-4d51-92c1-3e00b62d2ded tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:17.639460 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a3faaef1-ccb0-4d51-92c1-3e00b62d2ded tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:17.773139 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-a3faaef1-ccb0-4d51-92c1-3e00b62d2ded tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:17.780694 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-a3faaef1-ccb0-4d51-92c1-3e00b62d2ded tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9" status: 200 len: 1366 microversion: 2.1 time: 0.153796 Jun 24 10:08:17.781255 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 430/880] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:08:17 2022] GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:08:18.022187 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-8d666dd1-cd10-4419-a29b-9c143adf1e30 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:18.023478 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-8d666dd1-cd10-4419-a29b-9c143adf1e30 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:18.030507 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8d666dd1-cd10-4419-a29b-9c143adf1e30 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:18.030956 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8d666dd1-cd10-4419-a29b-9c143adf1e30 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:18.031743 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8d666dd1-cd10-4419-a29b-9c143adf1e30 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:18.032215 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8d666dd1-cd10-4419-a29b-9c143adf1e30 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:18.179572 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-8d666dd1-cd10-4419-a29b-9c143adf1e30 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:18.188039 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-8d666dd1-cd10-4419-a29b-9c143adf1e30 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:18.189749 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-8d666dd1-cd10-4419-a29b-9c143adf1e30 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:18.191572 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-8d666dd1-cd10-4419-a29b-9c143adf1e30 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1730 microversion: 2.20 time: 0.174115 Jun 24 10:08:18.192245 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 451/881] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:08:18 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:08:18.798432 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-848f5213-92d0-4da3-afb0-bc7fba0d27a5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:18.799049 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-848f5213-92d0-4da3-afb0-bc7fba0d27a5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:18.811338 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-848f5213-92d0-4da3-afb0-bc7fba0d27a5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:18.811754 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-848f5213-92d0-4da3-afb0-bc7fba0d27a5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:18.812580 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-848f5213-92d0-4da3-afb0-bc7fba0d27a5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:18.814720 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-848f5213-92d0-4da3-afb0-bc7fba0d27a5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:18.970934 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-848f5213-92d0-4da3-afb0-bc7fba0d27a5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:18.979733 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-848f5213-92d0-4da3-afb0-bc7fba0d27a5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9" status: 200 len: 1366 microversion: 2.1 time: 0.185302 Jun 24 10:08:18.980335 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 431/882] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:08:18 2022] GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:08:19.210490 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-c6968e66-6e51-464d-b245-24dc0c3a30fc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:19.211109 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-c6968e66-6e51-464d-b245-24dc0c3a30fc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:19.217831 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c6968e66-6e51-464d-b245-24dc0c3a30fc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:19.218287 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c6968e66-6e51-464d-b245-24dc0c3a30fc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:19.219056 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c6968e66-6e51-464d-b245-24dc0c3a30fc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:19.219494 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c6968e66-6e51-464d-b245-24dc0c3a30fc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:19.352341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-c6968e66-6e51-464d-b245-24dc0c3a30fc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:19.360386 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-c6968e66-6e51-464d-b245-24dc0c3a30fc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:19.361897 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-c6968e66-6e51-464d-b245-24dc0c3a30fc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:19.363067 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-c6968e66-6e51-464d-b245-24dc0c3a30fc tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1730 microversion: 2.20 time: 0.157302 Jun 24 10:08:19.363631 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 452/883] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:08:19 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:08:19.997359 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-d2955b77-fadb-4e68-bf2a-0d2c81c2c959 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:19.997980 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-d2955b77-fadb-4e68-bf2a-0d2c81c2c959 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:20.005428 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d2955b77-fadb-4e68-bf2a-0d2c81c2c959 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:20.005885 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d2955b77-fadb-4e68-bf2a-0d2c81c2c959 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:20.006671 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d2955b77-fadb-4e68-bf2a-0d2c81c2c959 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:20.007114 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d2955b77-fadb-4e68-bf2a-0d2c81c2c959 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:20.062198 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-32941e43-1b1e-47e5-81c7-16e4305b7d8c req-19fc395c-189f-40cf-8fb0-cad7bb39f390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03050a70-dac3-49b8-a4ab-e73de4421841", "name": "network-vif-plugged", "status": "completed", "tag": "66641946-e924-41f5-ad9f-d918c412d89d"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:08:20.071033 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-32941e43-1b1e-47e5-81c7-16e4305b7d8c req-19fc395c-189f-40cf-8fb0-cad7bb39f390 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:20.071735 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-32941e43-1b1e-47e5-81c7-16e4305b7d8c req-19fc395c-189f-40cf-8fb0-cad7bb39f390 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:20.083001 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-32941e43-1b1e-47e5-81c7-16e4305b7d8c req-19fc395c-189f-40cf-8fb0-cad7bb39f390 service nova] Creating event network-vif-plugged:66641946-e924-41f5-ad9f-d918c412d89d for instance 03050a70-dac3-49b8-a4ab-e73de4421841 on hv-cinder-84327 Jun 24 10:08:20.088246 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-32941e43-1b1e-47e5-81c7-16e4305b7d8c req-19fc395c-189f-40cf-8fb0-cad7bb39f390 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030179 Jun 24 10:08:20.088851 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 453/884] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:08:20.141458 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d2955b77-fadb-4e68-bf2a-0d2c81c2c959 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:20.149523 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-d2955b77-fadb-4e68-bf2a-0d2c81c2c959 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9" status: 200 len: 1556 microversion: 2.1 time: 0.156033 Jun 24 10:08:20.150910 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 432/885] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:08:19 2022] GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:08:20.169657 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-6f1472b2-4f71-4401-be6f-087d4d18b449 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:20.170311 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-6f1472b2-4f71-4401-be6f-087d4d18b449 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:20.177750 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6f1472b2-4f71-4401-be6f-087d4d18b449 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:20.178325 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6f1472b2-4f71-4401-be6f-087d4d18b449 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:20.179186 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6f1472b2-4f71-4401-be6f-087d4d18b449 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:20.179695 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6f1472b2-4f71-4401-be6f-087d4d18b449 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:20.194911 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=100 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:08:20.267265 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-6f1472b2-4f71-4401-be6f-087d4d18b449 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102982 Jun 24 10:08:20.267912 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 454/886] 10.222.0.26 () {58 vars in 1274 bytes} [Fri Jun 24 10:08:20 2022] GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:08:20.382123 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-71fd0ad8-676f-43e5-8c19-adfa5d9081e7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:20.383104 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-71fd0ad8-676f-43e5-8c19-adfa5d9081e7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:20.390469 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-71fd0ad8-676f-43e5-8c19-adfa5d9081e7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:20.391380 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-71fd0ad8-676f-43e5-8c19-adfa5d9081e7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:20.392444 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-71fd0ad8-676f-43e5-8c19-adfa5d9081e7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:20.393043 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-71fd0ad8-676f-43e5-8c19-adfa5d9081e7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:20.606871 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-71fd0ad8-676f-43e5-8c19-adfa5d9081e7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:20.616948 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-71fd0ad8-676f-43e5-8c19-adfa5d9081e7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:20.618810 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-71fd0ad8-676f-43e5-8c19-adfa5d9081e7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:20.620022 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-71fd0ad8-676f-43e5-8c19-adfa5d9081e7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1730 microversion: 2.20 time: 0.242280 Jun 24 10:08:20.623929 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 433/887] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:08:20 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1730 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:08:21.388644 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-19b93797-ffea-4fd7-890b-770224142590 req-81072282-3fc7-45e0-97a2-a93ca52d983e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f866b577-5318-4708-a475-c7121b57d3e9", "tag": "bac3a226-ee26-4181-b090-f29884ba1887"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:08:21.397848 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-19b93797-ffea-4fd7-890b-770224142590 req-81072282-3fc7-45e0-97a2-a93ca52d983e service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:21.398290 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-19b93797-ffea-4fd7-890b-770224142590 req-81072282-3fc7-45e0-97a2-a93ca52d983e service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:21.412072 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-19b93797-ffea-4fd7-890b-770224142590 req-81072282-3fc7-45e0-97a2-a93ca52d983e service nova] Creating event network-changed:bac3a226-ee26-4181-b090-f29884ba1887 for instance f866b577-5318-4708-a475-c7121b57d3e9 on hv-cinder-84327 Jun 24 10:08:21.417593 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-19b93797-ffea-4fd7-890b-770224142590 req-81072282-3fc7-45e0-97a2-a93ca52d983e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033514 Jun 24 10:08:21.418211 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 455/888] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:08:21.638858 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-72cb7d65-f244-4447-bdbb-73411682005e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:21.639579 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-72cb7d65-f244-4447-bdbb-73411682005e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:21.646614 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-72cb7d65-f244-4447-bdbb-73411682005e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:21.647167 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-72cb7d65-f244-4447-bdbb-73411682005e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:21.648017 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-72cb7d65-f244-4447-bdbb-73411682005e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:21.648552 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-72cb7d65-f244-4447-bdbb-73411682005e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:21.780742 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-72cb7d65-f244-4447-bdbb-73411682005e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:21.789097 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-72cb7d65-f244-4447-bdbb-73411682005e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:21.790587 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-72cb7d65-f244-4447-bdbb-73411682005e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:21.791817 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-72cb7d65-f244-4447-bdbb-73411682005e tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1730 microversion: 2.20 time: 0.156811 Jun 24 10:08:21.792408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 434/889] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:08:21 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:08:22.812237 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-edd1fe44-0e47-4b98-837a-5464d333fd92 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:22.812952 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-edd1fe44-0e47-4b98-837a-5464d333fd92 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:22.819565 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-edd1fe44-0e47-4b98-837a-5464d333fd92 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:22.824698 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-edd1fe44-0e47-4b98-837a-5464d333fd92 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:22.824698 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-edd1fe44-0e47-4b98-837a-5464d333fd92 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:22.824698 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-edd1fe44-0e47-4b98-837a-5464d333fd92 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:22.979942 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-edd1fe44-0e47-4b98-837a-5464d333fd92 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:22.988990 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-edd1fe44-0e47-4b98-837a-5464d333fd92 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:22.990512 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-edd1fe44-0e47-4b98-837a-5464d333fd92 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:22.991702 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-edd1fe44-0e47-4b98-837a-5464d333fd92 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1730 microversion: 2.20 time: 0.184507 Jun 24 10:08:22.992295 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 456/890] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:08:22 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:08:24.009675 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-6d4334fc-c5f9-4eb2-9fbe-e52001e1bef2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:24.010407 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-6d4334fc-c5f9-4eb2-9fbe-e52001e1bef2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:24.017171 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6d4334fc-c5f9-4eb2-9fbe-e52001e1bef2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:24.017626 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6d4334fc-c5f9-4eb2-9fbe-e52001e1bef2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:24.018578 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6d4334fc-c5f9-4eb2-9fbe-e52001e1bef2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:24.019020 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6d4334fc-c5f9-4eb2-9fbe-e52001e1bef2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:24.170331 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-6d4334fc-c5f9-4eb2-9fbe-e52001e1bef2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:24.182185 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-6d4334fc-c5f9-4eb2-9fbe-e52001e1bef2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:24.183350 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-6d4334fc-c5f9-4eb2-9fbe-e52001e1bef2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:24.184544 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-6d4334fc-c5f9-4eb2-9fbe-e52001e1bef2 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1717 microversion: 2.20 time: 0.178825 Jun 24 10:08:24.185095 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 435/891] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:08:24 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1717 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:08:57.491578 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-e009ec81-1dc3-4c88-a4ec-ded32f31d104 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:57.492538 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-e009ec81-1dc3-4c88-a4ec-ded32f31d104 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:57.494937 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_api:SELECT=49 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:08:57.495610 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=9 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:08:57.500395 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e009ec81-1dc3-4c88-a4ec-ded32f31d104 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:57.500857 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e009ec81-1dc3-4c88-a4ec-ded32f31d104 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:57.502253 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e009ec81-1dc3-4c88-a4ec-ded32f31d104 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:57.502869 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e009ec81-1dc3-4c88-a4ec-ded32f31d104 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:57.532458 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-e009ec81-1dc3-4c88-a4ec-ded32f31d104 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044759 Jun 24 10:08:57.533030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 457/892] 10.222.0.26 () {60 vars in 1342 bytes} [Fri Jun 24 10:08:57 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:08:57.604508 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-9a55be47-0035-4d28-b21a-4927340f6542 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:57.605072 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-9a55be47-0035-4d28-b21a-4927340f6542 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:57.607606 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:08:57.608360 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=82 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:08:57.614821 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9a55be47-0035-4d28-b21a-4927340f6542 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:57.615380 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9a55be47-0035-4d28-b21a-4927340f6542 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:57.616275 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9a55be47-0035-4d28-b21a-4927340f6542 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:57.617232 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9a55be47-0035-4d28-b21a-4927340f6542 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:57.640730 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-a790fcb5-36e7-4c8e-8a84-42e383f8bb73 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:57.641327 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-a790fcb5-36e7-4c8e-8a84-42e383f8bb73 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:57.645396 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-9a55be47-0035-4d28-b21a-4927340f6542 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Going to try to terminate instance {{(pid=124980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:08:57.653731 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a790fcb5-36e7-4c8e-8a84-42e383f8bb73 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:57.654618 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a790fcb5-36e7-4c8e-8a84-42e383f8bb73 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:57.654932 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a790fcb5-36e7-4c8e-8a84-42e383f8bb73 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:57.655363 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a790fcb5-36e7-4c8e-8a84-42e383f8bb73 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:57.684090 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-a790fcb5-36e7-4c8e-8a84-42e383f8bb73 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9/ips" status: 200 len: 149 microversion: 2.1 time: 0.047609 Jun 24 10:08:57.688402 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 458/893] 10.222.0.26 () {58 vars in 1247 bytes} [Fri Jun 24 10:08:57 2022] GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:08:57.696531 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-b4953fbf-5f11-4cbb-9cc7-76384019871a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9642563-bbed-4a43-8fdd-040832474021"}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:08:57.697604 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-b4953fbf-5f11-4cbb-9cc7-76384019871a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:57.703638 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b4953fbf-5f11-4cbb-9cc7-76384019871a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:57.704087 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b4953fbf-5f11-4cbb-9cc7-76384019871a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:57.704895 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b4953fbf-5f11-4cbb-9cc7-76384019871a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:57.705333 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b4953fbf-5f11-4cbb-9cc7-76384019871a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:57.786557 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-b4953fbf-5f11-4cbb-9cc7-76384019871a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] HTTP exception thrown: Invalid volume: volume c9642563-bbed-4a43-8fdd-040832474021 is already attached to instances: f0aef362-32c9-463b-ba31-93ce5c561487 Jun 24 10:08:57.788393 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-b4953fbf-5f11-4cbb-9cc7-76384019871a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Request method failure captured: Jun 24 10:08:57.788393 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: POST /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9/os-volume_attachments HTTP/1.1 Jun 24 10:08:57.788393 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:08:57.788393 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:08:57.788393 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:08:57.788393 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 74 Jun 24 10:08:57.788393 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:08:57.788393 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:08:57.788393 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:08:57.788393 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:08:57.788393 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitYyzKx6mxHcouBd786V7PSRKtqG7vQygoeml9ZFRI4t-s7SskaI_N7VnM2cMTHq18lI9OepR13ZTFpIKllTjNCYBqowBTJBvubT2uG08oWBo29qBWawe6q0x1WdImPCEss3dF17N9x8N3_7uAMt0BoG5BjapetFSeerYUrODzwv3CBQ Jun 24 10:08:57.788393 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:08:57.788393 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:08:57.788393 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:08:57.788393 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:08:57.788393 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:08:57.788393 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:08:57.788393 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: 64b655c9ef0948c099f60649b9d5e78d Jun 24 10:08:57.788393 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:08:57.788393 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:08:57.788393 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:08:57.790033 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/64b655c9ef0948c099f60649b9d5e78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_64b655c9ef0948c099f60649b9d5e78d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/64b655c9ef0948c099f60649b9d5e78d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/64b655c9ef0948c099f60649b9d5e78d"}]}] Jun 24 10:08:57.790033 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:08:57.790033 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: 64b655c9ef0948c099f60649b9d5e78d Jun 24 10:08:57.790033 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:08:57.790033 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-AttachVolumeNegativeTest-1676240271-project Jun 24 10:08:57.790033 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:08:57.790033 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:08:57.790033 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: f2c97e68f66142f9b502b215313f7e80 Jun 24 10:08:57.790033 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-AttachVolumeNegativeTest-1676240271-project Jun 24 10:08:57.790033 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Jun 24 10:08:57.790033 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {"volumeAttachment": {"volumeId": "c9642563-bbed-4a43-8fdd-040832474021"}} Jun 24 10:08:57.790033 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: > Jun 24 10:08:57.790949 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Invalid volume: volume c9642563-bbed-4a43-8fdd-040832474021 is already attached to instances: f0aef362-32c9-463b-ba31-93ce5c561487 Jun 24 10:08:57.790949 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'server_id': 'f866b577-5318-4708-a475-c7121b57d3e9', 'body': {'volumeAttachment': {'volumeId': 'c9642563-bbed-4a43-8fdd-040832474021'}}} Jun 24 10:08:57.790949 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:08:57.790949 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:08:57.790949 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 10:08:57.790949 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 10:08:57.790949 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 10:08:57.790949 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 10:08:57.790949 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 10:08:57.790949 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 10:08:57.790949 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 24 10:08:57.790949 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 24 10:08:57.790949 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 24 10:08:57.790949 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 24 10:08:57.790949 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c9642563-bbed-4a43-8fdd-040832474021 is already attached to instances: f0aef362-32c9-463b-ba31-93ce5c561487 Jun 24 10:08:57.790949 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:08:57.790949 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:08:57.790949 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:08:57.790949 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:08:57.793048 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:08:57.793048 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:08:57.793048 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:08:57.793048 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:08:57.793048 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:08:57.793048 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:08:57.793048 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 10:08:57.793048 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:08:57.793048 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 10:08:57.793048 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:08:57.793048 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 10:08:57.793048 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:08:57.793048 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 24 10:08:57.793048 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 10:08:57.793048 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c9642563-bbed-4a43-8fdd-040832474021 is already attached to instances: f0aef362-32c9-463b-ba31-93ce5c561487 Jun 24 10:08:57.793048 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:08:57.793048 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:08:57.793048 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:08:57.793048 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:08:57.793048 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:08:57.794545 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:08:57.794545 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:08:57.794545 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:08:57.794545 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c9642563-bbed-4a43-8fdd-040832474021 is already attached to instances: f0aef362-32c9-463b-ba31-93ce5c561487 Jun 24 10:08:57.794545 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:08:57.794545 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-b4953fbf-5f11-4cbb-9cc7-76384019871a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Returning 400 to user: Invalid volume: volume c9642563-bbed-4a43-8fdd-040832474021 is already attached to instances: f0aef362-32c9-463b-ba31-93ce5c561487 {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:08:57.794545 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-b4953fbf-5f11-4cbb-9cc7-76384019871a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "POST /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097417 Jun 24 10:08:57.794545 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 459/894] 10.222.0.26 () {60 vars in 1322 bytes} [Fri Jun 24 10:08:57 2022] POST /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 24 10:08:57.798448 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-8601be91-9df0-40db-b831-83c8e619f26e tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:57.799629 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-8601be91-9df0-40db-b831-83c8e619f26e tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:57.806167 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8601be91-9df0-40db-b831-83c8e619f26e tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:57.811000 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8601be91-9df0-40db-b831-83c8e619f26e tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:57.811000 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8601be91-9df0-40db-b831-83c8e619f26e tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:57.811000 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8601be91-9df0-40db-b831-83c8e619f26e tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:57.834764 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-8601be91-9df0-40db-b831-83c8e619f26e tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Going to try to terminate instance {{(pid=124979) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:08:58.001918 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-9a55be47-0035-4d28-b21a-4927340f6542 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "DELETE /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 204 len: 0 microversion: 2.20 time: 0.401585 Jun 24 10:08:58.002543 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 436/895] 10.222.0.26 () {60 vars in 1279 bytes} [Fri Jun 24 10:08:57 2022] DELETE /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 24 10:08:58.010888 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-659ccee0-e700-4b07-bf8a-9c6e885667fe tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:58.012312 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-659ccee0-e700-4b07-bf8a-9c6e885667fe tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:58.017883 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-659ccee0-e700-4b07-bf8a-9c6e885667fe tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:58.018344 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-659ccee0-e700-4b07-bf8a-9c6e885667fe tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:58.019124 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-659ccee0-e700-4b07-bf8a-9c6e885667fe tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:58.019571 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-659ccee0-e700-4b07-bf8a-9c6e885667fe tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:58.157290 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-659ccee0-e700-4b07-bf8a-9c6e885667fe tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:58.165943 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-659ccee0-e700-4b07-bf8a-9c6e885667fe tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:58.167436 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-659ccee0-e700-4b07-bf8a-9c6e885667fe tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:58.168647 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-659ccee0-e700-4b07-bf8a-9c6e885667fe tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1723 microversion: 2.20 time: 0.161926 Jun 24 10:08:58.169203 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 437/896] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:08:58 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:08:58.258597 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-8601be91-9df0-40db-b831-83c8e619f26e tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9" status: 204 len: 0 microversion: 2.1 time: 0.463543 Jun 24 10:08:58.259204 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 460/897] 10.222.0.26 () {58 vars in 1238 bytes} [Fri Jun 24 10:08:57 2022] DELETE /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:08:58.268614 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-d401a155-5f32-4b2b-a68b-5835de7ff92d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:58.269267 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-d401a155-5f32-4b2b-a68b-5835de7ff92d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:58.276655 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d401a155-5f32-4b2b-a68b-5835de7ff92d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:58.277113 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d401a155-5f32-4b2b-a68b-5835de7ff92d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:58.277898 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d401a155-5f32-4b2b-a68b-5835de7ff92d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:58.278468 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d401a155-5f32-4b2b-a68b-5835de7ff92d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:58.415450 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d401a155-5f32-4b2b-a68b-5835de7ff92d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:58.423803 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-d401a155-5f32-4b2b-a68b-5835de7ff92d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9" status: 200 len: 1680 microversion: 2.1 time: 0.159697 Jun 24 10:08:58.424407 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 438/898] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:08:58 2022] GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:08:59.194024 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-4e4decaf-f9a3-44f3-a756-0f30457b49cf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:59.194730 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-4e4decaf-f9a3-44f3-a756-0f30457b49cf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:59.202220 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4e4decaf-f9a3-44f3-a756-0f30457b49cf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:59.203118 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4e4decaf-f9a3-44f3-a756-0f30457b49cf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:59.203587 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4e4decaf-f9a3-44f3-a756-0f30457b49cf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:59.204016 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4e4decaf-f9a3-44f3-a756-0f30457b49cf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:59.350673 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-4e4decaf-f9a3-44f3-a756-0f30457b49cf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:59.359808 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-4e4decaf-f9a3-44f3-a756-0f30457b49cf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:59.361456 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-4e4decaf-f9a3-44f3-a756-0f30457b49cf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:59.363167 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-4e4decaf-f9a3-44f3-a756-0f30457b49cf tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1723 microversion: 2.20 time: 0.173990 Jun 24 10:08:59.363738 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 461/899] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:08:59 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:08:59.441042 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-097c7796-4090-4e82-93b7-60bbebc0db7a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:59.441656 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-097c7796-4090-4e82-93b7-60bbebc0db7a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:08:59.448434 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-097c7796-4090-4e82-93b7-60bbebc0db7a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:59.448889 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-097c7796-4090-4e82-93b7-60bbebc0db7a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:59.449665 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-097c7796-4090-4e82-93b7-60bbebc0db7a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:08:59.450107 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-097c7796-4090-4e82-93b7-60bbebc0db7a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:08:59.583521 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-097c7796-4090-4e82-93b7-60bbebc0db7a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:08:59.591648 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-097c7796-4090-4e82-93b7-60bbebc0db7a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9" status: 200 len: 1680 microversion: 2.1 time: 0.154548 Jun 24 10:08:59.592254 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 439/900] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:08:59 2022] GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:09:00.382765 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-38a7cebb-29ba-468c-aa17-8a671f61840c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:00.383379 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-38a7cebb-29ba-468c-aa17-8a671f61840c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:00.390060 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-38a7cebb-29ba-468c-aa17-8a671f61840c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:00.390510 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-38a7cebb-29ba-468c-aa17-8a671f61840c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:00.391277 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-38a7cebb-29ba-468c-aa17-8a671f61840c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:00.391717 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-38a7cebb-29ba-468c-aa17-8a671f61840c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:00.533155 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-38a7cebb-29ba-468c-aa17-8a671f61840c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:00.541924 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-38a7cebb-29ba-468c-aa17-8a671f61840c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:00.543448 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-38a7cebb-29ba-468c-aa17-8a671f61840c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:00.544666 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-38a7cebb-29ba-468c-aa17-8a671f61840c tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1723 microversion: 2.20 time: 0.165941 Jun 24 10:09:00.545228 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 462/901] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:09:00 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:09:00.610169 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-482f71b8-7ee4-40bd-b996-43ad99bcab85 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:00.610789 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-482f71b8-7ee4-40bd-b996-43ad99bcab85 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:00.618266 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-482f71b8-7ee4-40bd-b996-43ad99bcab85 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:00.618720 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-482f71b8-7ee4-40bd-b996-43ad99bcab85 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:00.619574 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-482f71b8-7ee4-40bd-b996-43ad99bcab85 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:00.620224 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-482f71b8-7ee4-40bd-b996-43ad99bcab85 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:00.832194 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-482f71b8-7ee4-40bd-b996-43ad99bcab85 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:00.832194 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-482f71b8-7ee4-40bd-b996-43ad99bcab85 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9" status: 200 len: 1680 microversion: 2.1 time: 0.216046 Jun 24 10:09:00.832194 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 440/902] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:09:00 2022] GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 => generated 1680 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:09:01.563666 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-1fc4c2c0-e729-4d29-8637-c47726b54dcb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:01.565358 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-1fc4c2c0-e729-4d29-8637-c47726b54dcb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:01.571431 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1fc4c2c0-e729-4d29-8637-c47726b54dcb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:01.571887 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1fc4c2c0-e729-4d29-8637-c47726b54dcb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:01.572700 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1fc4c2c0-e729-4d29-8637-c47726b54dcb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:01.573138 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1fc4c2c0-e729-4d29-8637-c47726b54dcb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:01.722397 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-1fc4c2c0-e729-4d29-8637-c47726b54dcb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:01.731327 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-1fc4c2c0-e729-4d29-8637-c47726b54dcb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:01.733348 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-1fc4c2c0-e729-4d29-8637-c47726b54dcb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:01.734727 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-1fc4c2c0-e729-4d29-8637-c47726b54dcb tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1723 microversion: 2.20 time: 0.174914 Jun 24 10:09:01.735485 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 463/903] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:09:01 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:09:01.839878 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-4d51c5d6-7de7-465d-ad2e-7795f6ed7dde tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:01.840597 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-4d51c5d6-7de7-465d-ad2e-7795f6ed7dde tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:01.847849 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4d51c5d6-7de7-465d-ad2e-7795f6ed7dde tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:01.849086 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4d51c5d6-7de7-465d-ad2e-7795f6ed7dde tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:01.849086 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4d51c5d6-7de7-465d-ad2e-7795f6ed7dde tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:01.849357 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4d51c5d6-7de7-465d-ad2e-7795f6ed7dde tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:01.999464 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-4d51c5d6-7de7-465d-ad2e-7795f6ed7dde tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:02.007832 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-4d51c5d6-7de7-465d-ad2e-7795f6ed7dde tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9" status: 200 len: 1680 microversion: 2.1 time: 0.172042 Jun 24 10:09:02.008424 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 441/904] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:09:01 2022] GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:09:02.458926 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-546e1061-0eb7-45d2-803a-1946e1891420 req-385f87e8-7494-4ab9-b019-61045ddfc282 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03050a70-dac3-49b8-a4ab-e73de4421841", "name": "network-vif-deleted", "tag": "66641946-e924-41f5-ad9f-d918c412d89d"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:09:02.473796 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-546e1061-0eb7-45d2-803a-1946e1891420 req-385f87e8-7494-4ab9-b019-61045ddfc282 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:02.479796 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-546e1061-0eb7-45d2-803a-1946e1891420 req-385f87e8-7494-4ab9-b019-61045ddfc282 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:02.491871 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-546e1061-0eb7-45d2-803a-1946e1891420 req-385f87e8-7494-4ab9-b019-61045ddfc282 service nova] Creating event network-vif-deleted:66641946-e924-41f5-ad9f-d918c412d89d for instance 03050a70-dac3-49b8-a4ab-e73de4421841 on hv-cinder-84327 Jun 24 10:09:02.503513 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-546e1061-0eb7-45d2-803a-1946e1891420 req-385f87e8-7494-4ab9-b019-61045ddfc282 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058779 Jun 24 10:09:02.505251 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 464/905] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:09:02.754969 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-d265c5b1-6b84-4a13-8bf7-55698484a863 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:02.755997 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-d265c5b1-6b84-4a13-8bf7-55698484a863 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:02.762638 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d265c5b1-6b84-4a13-8bf7-55698484a863 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:02.763463 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d265c5b1-6b84-4a13-8bf7-55698484a863 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:02.764509 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d265c5b1-6b84-4a13-8bf7-55698484a863 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:02.765176 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d265c5b1-6b84-4a13-8bf7-55698484a863 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:02.899422 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d265c5b1-6b84-4a13-8bf7-55698484a863 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:02.909327 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d265c5b1-6b84-4a13-8bf7-55698484a863 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:02.915453 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d265c5b1-6b84-4a13-8bf7-55698484a863 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cd894c323c604ed593a01d17092e6c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77797eae68a42639f886f64db5f5598', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:02.919495 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-d265c5b1-6b84-4a13-8bf7-55698484a863 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 200 len: 1366 microversion: 2.20 time: 0.169061 Jun 24 10:09:02.920344 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 442/906] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:09:02 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:09:03.027033 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-d8d79b41-b9c0-4dc1-868b-836308c73140 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:03.028570 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-d8d79b41-b9c0-4dc1-868b-836308c73140 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:03.036868 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d8d79b41-b9c0-4dc1-868b-836308c73140 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:03.037342 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d8d79b41-b9c0-4dc1-868b-836308c73140 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:03.038111 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d8d79b41-b9c0-4dc1-868b-836308c73140 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:03.038548 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d8d79b41-b9c0-4dc1-868b-836308c73140 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:03.138009 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d8d79b41-b9c0-4dc1-868b-836308c73140 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:03.146235 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-d8d79b41-b9c0-4dc1-868b-836308c73140 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9" status: 200 len: 1613 microversion: 2.1 time: 0.124305 Jun 24 10:09:03.150103 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 465/907] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:09:03 2022] GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 => generated 1613 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:09:03.947266 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-efd7d407-2a01-4479-9220-59e3c776e6fe tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:03.947885 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-efd7d407-2a01-4479-9220-59e3c776e6fe tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:03.955163 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-efd7d407-2a01-4479-9220-59e3c776e6fe tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:03.955620 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-efd7d407-2a01-4479-9220-59e3c776e6fe tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:03.956424 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-efd7d407-2a01-4479-9220-59e3c776e6fe tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:03.956903 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-efd7d407-2a01-4479-9220-59e3c776e6fe tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:03.975656 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.wsgi [None req-efd7d407-2a01-4479-9220-59e3c776e6fe tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] HTTP exception thrown: Instance 03050a70-dac3-49b8-a4ab-e73de4421841 could not be found. Jun 24 10:09:03.977572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-efd7d407-2a01-4479-9220-59e3c776e6fe tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Request method failure captured: Jun 24 10:09:03.977572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: request: GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 HTTP/1.1 Jun 24 10:09:03.977572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept: application/json Jun 24 10:09:03.977572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept-Encoding: identity Jun 24 10:09:03.977572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Connection: close Jun 24 10:09:03.977572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Length: 0 Jun 24 10:09:03.977572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Type: application/json Jun 24 10:09:03.977572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Host: 10.222.0.26 Jun 24 10:09:03.977572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Openstack-System-Scope: None Jun 24 10:09:03.977572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: User-Agent: python-urllib3/1.26.9 Jun 24 10:09:03.977572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Auth-Token: gAAAAABitYtjkJw2bHOeZ2cDcfFEKgEvHgE9PcrydC3_0C2_vVDx3RS9Ijzx0RavfKpEzUfBr0snAkOZjXp0ZofsjOoJtHAlurMx_T47sNxT9CHDHEqfOmPfxhcpA_rDpqhSmEtyZVp1ZLcMt9dR4aAJniy9HaUfNPmh-rWZXp0XoJQb88TeRxk Jun 24 10:09:03.977572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Id: None Jun 24 10:09:03.977572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Name: None Jun 24 10:09:03.977572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Identity-Status: Confirmed Jun 24 10:09:03.977572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Is-Admin-Project: True Jun 24 10:09:03.977572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 10:09:03.977572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Id: default Jun 24 10:09:03.977572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Name: Default Jun 24 10:09:03.977572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Id: a77797eae68a42639f886f64db5f5598 Jun 24 10:09:03.977572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1169333461 Jun 24 10:09:03.977572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Role: reader,member Jun 24 10:09:03.977572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Roles: reader,member Jun 24 10:09:03.985046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a77797eae68a42639f886f64db5f5598"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a77797eae68a42639f886f64db5f5598", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a77797eae68a42639f886f64db5f5598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a77797eae68a42639f886f64db5f5598"}]}] Jun 24 10:09:03.985046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1169333461 Jun 24 10:09:03.985046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Id: a77797eae68a42639f886f64db5f5598 Jun 24 10:09:03.985046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1169333461 Jun 24 10:09:03.985046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User: tempest-AttachVolumeShelveTestJSON-1169333461-project Jun 24 10:09:03.985046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Id: default Jun 24 10:09:03.985046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Name: Default Jun 24 10:09:03.985046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Id: cd894c323c604ed593a01d17092e6c2a Jun 24 10:09:03.985046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1169333461-project Jun 24 10:09:03.985046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: method: > Jun 24 10:09:03.985046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: exception: Instance 03050a70-dac3-49b8-a4ab-e73de4421841 could not be found. Jun 24 10:09:03.985046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: action_args: {'id': '03050a70-dac3-49b8-a4ab-e73de4421841'} Jun 24 10:09:03.986000 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:09:03.986000 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:03.986000 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:09:03.986000 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:09:03.986000 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:09:03.986000 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:09:03.986000 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:09:03.986000 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:09:03.986000 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:09:03.986000 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:09:03.986000 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03050a70-dac3-49b8-a4ab-e73de4421841 could not be found. Jun 24 10:09:03.986000 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:09:03.986000 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:09:03.986000 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:09:03.986000 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:03.986000 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:09:03.986000 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:09:03.986000 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:09:03.986000 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:09:03.986000 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:09:03.987538 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:09:03.987538 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:09:03.987538 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:09:03.987538 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:09:03.987538 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:09:03.987538 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:09:03.987538 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:09:03.987538 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03050a70-dac3-49b8-a4ab-e73de4421841 could not be found. Jun 24 10:09:03.987538 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:09:03.987538 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:09:03.987538 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:09:03.987538 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:03.987538 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:09:03.987538 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:09:03.987538 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:09:03.987538 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:09:03.987538 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03050a70-dac3-49b8-a4ab-e73de4421841 could not be found. Jun 24 10:09:03.987538 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:09:03.989028 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-efd7d407-2a01-4479-9220-59e3c776e6fe tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Returning 404 to user: Instance 03050a70-dac3-49b8-a4ab-e73de4421841 could not be found. {{(pid=124980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:09:03.989028 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-efd7d407-2a01-4479-9220-59e3c776e6fe tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 404 len: 111 microversion: 2.20 time: 0.036964 Jun 24 10:09:03.989028 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 443/908] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:09:03 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 10:09:03.994027 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-5f980a8b-578b-4e63-9829-0722c66996ee tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '.version_select at 0x7f0309b423a0>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:04.112346 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-5f980a8b-578b-4e63-9829-0722c66996ee tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1539427661" status: 204 len: 0 microversion: 2.20 time: 0.125364 Jun 24 10:09:04.113278 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 466/909] 10.222.0.26 () {60 vars in 1261 bytes} [Fri Jun 24 10:09:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1539427661 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 10:09:04.163940 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-d70196ad-8c54-4c67-ab19-d2527208ea5c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:04.164597 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-d70196ad-8c54-4c67-ab19-d2527208ea5c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:04.171968 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d70196ad-8c54-4c67-ab19-d2527208ea5c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:04.172764 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d70196ad-8c54-4c67-ab19-d2527208ea5c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:04.174118 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d70196ad-8c54-4c67-ab19-d2527208ea5c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:04.174557 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d70196ad-8c54-4c67-ab19-d2527208ea5c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:04.217930 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d70196ad-8c54-4c67-ab19-d2527208ea5c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:04.218651 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d70196ad-8c54-4c67-ab19-d2527208ea5c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:04.219278 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.objects.instance [None req-d70196ad-8c54-4c67-ab19-d2527208ea5c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lazy-loading 'fault' on Instance uuid f866b577-5318-4708-a475-c7121b57d3e9 {{(pid=124980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:09:04.286772 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d70196ad-8c54-4c67-ab19-d2527208ea5c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:04.294634 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-d70196ad-8c54-4c67-ab19-d2527208ea5c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9" status: 200 len: 1331 microversion: 2.1 time: 0.135237 Jun 24 10:09:04.295547 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 444/910] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:09:04 2022] GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 => generated 1331 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:09:04.558931 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-47837eac-b5c5-4f9a-995f-6785ec4ae3b7 req-e0c68962-0024-4b96-847d-5c66498d225f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f866b577-5318-4708-a475-c7121b57d3e9", "name": "network-vif-deleted", "tag": "bac3a226-ee26-4181-b090-f29884ba1887"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:09:04.568675 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-47837eac-b5c5-4f9a-995f-6785ec4ae3b7 req-e0c68962-0024-4b96-847d-5c66498d225f service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:04.569124 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-47837eac-b5c5-4f9a-995f-6785ec4ae3b7 req-e0c68962-0024-4b96-847d-5c66498d225f service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:04.587440 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-47837eac-b5c5-4f9a-995f-6785ec4ae3b7 req-e0c68962-0024-4b96-847d-5c66498d225f service nova] Creating event network-vif-deleted:bac3a226-ee26-4181-b090-f29884ba1887 for instance f866b577-5318-4708-a475-c7121b57d3e9 on hv-cinder-84327 Jun 24 10:09:04.595899 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-47837eac-b5c5-4f9a-995f-6785ec4ae3b7 req-e0c68962-0024-4b96-847d-5c66498d225f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039883 Jun 24 10:09:04.596797 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 467/911] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:09:05.313067 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-b5f444ec-8ab6-4e59-900f-dbc0f41b50fd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:05.313679 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-b5f444ec-8ab6-4e59-900f-dbc0f41b50fd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:05.320523 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b5f444ec-8ab6-4e59-900f-dbc0f41b50fd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:05.320985 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b5f444ec-8ab6-4e59-900f-dbc0f41b50fd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:05.321874 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b5f444ec-8ab6-4e59-900f-dbc0f41b50fd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:05.322303 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b5f444ec-8ab6-4e59-900f-dbc0f41b50fd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:05.338355 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.wsgi [None req-b5f444ec-8ab6-4e59-900f-dbc0f41b50fd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] HTTP exception thrown: Instance f866b577-5318-4708-a475-c7121b57d3e9 could not be found. Jun 24 10:09:05.340027 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-b5f444ec-8ab6-4e59-900f-dbc0f41b50fd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Request method failure captured: Jun 24 10:09:05.340027 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: request: GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 HTTP/1.1 Jun 24 10:09:05.340027 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept: application/json Jun 24 10:09:05.340027 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept-Encoding: identity Jun 24 10:09:05.340027 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Connection: close Jun 24 10:09:05.340027 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Length: 0 Jun 24 10:09:05.340027 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Type: application/json Jun 24 10:09:05.340027 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Host: 10.222.0.26 Jun 24 10:09:05.340027 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Openstack-System-Scope: None Jun 24 10:09:05.340027 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: User-Agent: python-urllib3/1.26.9 Jun 24 10:09:05.340027 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Auth-Token: gAAAAABitYyzKx6mxHcouBd786V7PSRKtqG7vQygoeml9ZFRI4t-s7SskaI_N7VnM2cMTHq18lI9OepR13ZTFpIKllTjNCYBqowBTJBvubT2uG08oWBo29qBWawe6q0x1WdImPCEss3dF17N9x8N3_7uAMt0BoG5BjapetFSeerYUrODzwv3CBQ Jun 24 10:09:05.340027 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Id: None Jun 24 10:09:05.340027 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Name: None Jun 24 10:09:05.340027 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Identity-Status: Confirmed Jun 24 10:09:05.340027 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Is-Admin-Project: True Jun 24 10:09:05.340027 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Id: default Jun 24 10:09:05.340027 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Name: Default Jun 24 10:09:05.340027 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Id: 64b655c9ef0948c099f60649b9d5e78d Jun 24 10:09:05.340027 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Name: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:09:05.340027 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Role: reader,member Jun 24 10:09:05.340027 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Roles: reader,member Jun 24 10:09:05.341454 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/64b655c9ef0948c099f60649b9d5e78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_64b655c9ef0948c099f60649b9d5e78d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/64b655c9ef0948c099f60649b9d5e78d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/64b655c9ef0948c099f60649b9d5e78d"}]}] Jun 24 10:09:05.341454 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:09:05.341454 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Id: 64b655c9ef0948c099f60649b9d5e78d Jun 24 10:09:05.341454 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:09:05.341454 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User: tempest-AttachVolumeNegativeTest-1676240271-project Jun 24 10:09:05.341454 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Id: default Jun 24 10:09:05.341454 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Name: Default Jun 24 10:09:05.341454 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Id: f2c97e68f66142f9b502b215313f7e80 Jun 24 10:09:05.341454 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Name: tempest-AttachVolumeNegativeTest-1676240271-project Jun 24 10:09:05.341454 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: method: > Jun 24 10:09:05.341454 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: exception: Instance f866b577-5318-4708-a475-c7121b57d3e9 could not be found. Jun 24 10:09:05.341454 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: action_args: {'id': 'f866b577-5318-4708-a475-c7121b57d3e9'} Jun 24 10:09:05.342361 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:09:05.342361 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:05.342361 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:09:05.342361 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:09:05.342361 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:09:05.342361 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:09:05.342361 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:09:05.342361 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:09:05.342361 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:09:05.342361 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:09:05.342361 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f866b577-5318-4708-a475-c7121b57d3e9 could not be found. Jun 24 10:09:05.342361 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:09:05.342361 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:09:05.342361 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:09:05.342361 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:05.342361 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:09:05.342361 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:09:05.342361 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:09:05.342361 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:09:05.342361 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:09:05.343869 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:09:05.343869 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:09:05.343869 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:09:05.343869 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:09:05.343869 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:09:05.343869 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:09:05.343869 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:09:05.343869 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f866b577-5318-4708-a475-c7121b57d3e9 could not be found. Jun 24 10:09:05.343869 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:09:05.343869 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:09:05.343869 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:09:05.343869 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:05.343869 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:09:05.343869 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:09:05.343869 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:09:05.343869 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:09:05.343869 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f866b577-5318-4708-a475-c7121b57d3e9 could not be found. Jun 24 10:09:05.343869 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:09:05.346075 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-b5f444ec-8ab6-4e59-900f-dbc0f41b50fd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Returning 404 to user: Instance f866b577-5318-4708-a475-c7121b57d3e9 could not be found. {{(pid=124980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:09:05.346075 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-b5f444ec-8ab6-4e59-900f-dbc0f41b50fd tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9" status: 404 len: 111 microversion: 2.1 time: 0.032403 Jun 24 10:09:05.346075 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 445/912] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:09:05 2022] GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:09:05.352065 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-a37b5cf6-debb-4205-bf69-ebf5530b638a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '.version_select at 0x7f0309bf0f70>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:05.552260 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-a37b5cf6-debb-4205-bf69-ebf5530b638a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1883686950" status: 202 len: 0 microversion: 2.1 time: 0.194472 Jun 24 10:09:05.552260 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 468/913] 10.222.0.26 () {58 vars in 1220 bytes} [Fri Jun 24 10:09:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1883686950 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:09:06.585320 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-97179273-556e-4a2b-9439-96a8243b8a94 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:06.586432 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-97179273-556e-4a2b-9439-96a8243b8a94 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:06.594003 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-97179273-556e-4a2b-9439-96a8243b8a94 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:06.594564 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-97179273-556e-4a2b-9439-96a8243b8a94 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:06.595441 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-97179273-556e-4a2b-9439-96a8243b8a94 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:06.596042 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-97179273-556e-4a2b-9439-96a8243b8a94 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:06.608427 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-a0e5a3ac-b6f3-424a-8e91-ca443005a3e6 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:06.610491 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-a0e5a3ac-b6f3-424a-8e91-ca443005a3e6 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:06.612845 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.wsgi [None req-97179273-556e-4a2b-9439-96a8243b8a94 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] HTTP exception thrown: Instance 03050a70-dac3-49b8-a4ab-e73de4421841 could not be found. Jun 24 10:09:06.614579 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-97179273-556e-4a2b-9439-96a8243b8a94 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Request method failure captured: Jun 24 10:09:06.614579 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: request: DELETE /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 HTTP/1.1 Jun 24 10:09:06.614579 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept: application/json Jun 24 10:09:06.614579 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept-Encoding: identity Jun 24 10:09:06.614579 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Connection: close Jun 24 10:09:06.614579 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Length: 0 Jun 24 10:09:06.614579 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Type: application/json Jun 24 10:09:06.614579 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Host: 10.222.0.26 Jun 24 10:09:06.614579 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Openstack-System-Scope: None Jun 24 10:09:06.614579 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: User-Agent: python-urllib3/1.26.9 Jun 24 10:09:06.614579 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Auth-Token: gAAAAABitYtjkJw2bHOeZ2cDcfFEKgEvHgE9PcrydC3_0C2_vVDx3RS9Ijzx0RavfKpEzUfBr0snAkOZjXp0ZofsjOoJtHAlurMx_T47sNxT9CHDHEqfOmPfxhcpA_rDpqhSmEtyZVp1ZLcMt9dR4aAJniy9HaUfNPmh-rWZXp0XoJQb88TeRxk Jun 24 10:09:06.614579 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Id: None Jun 24 10:09:06.614579 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Name: None Jun 24 10:09:06.614579 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Identity-Status: Confirmed Jun 24 10:09:06.614579 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Is-Admin-Project: True Jun 24 10:09:06.614579 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 10:09:06.614579 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Id: default Jun 24 10:09:06.614579 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Name: Default Jun 24 10:09:06.614579 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Id: a77797eae68a42639f886f64db5f5598 Jun 24 10:09:06.614579 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1169333461 Jun 24 10:09:06.614579 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Role: reader,member Jun 24 10:09:06.614579 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Roles: reader,member Jun 24 10:09:06.616496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a77797eae68a42639f886f64db5f5598"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a77797eae68a42639f886f64db5f5598", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a77797eae68a42639f886f64db5f5598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a77797eae68a42639f886f64db5f5598"}]}] Jun 24 10:09:06.616496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1169333461 Jun 24 10:09:06.616496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Id: a77797eae68a42639f886f64db5f5598 Jun 24 10:09:06.616496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1169333461 Jun 24 10:09:06.616496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User: tempest-AttachVolumeShelveTestJSON-1169333461-project Jun 24 10:09:06.616496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Id: default Jun 24 10:09:06.616496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Name: Default Jun 24 10:09:06.616496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Id: cd894c323c604ed593a01d17092e6c2a Jun 24 10:09:06.616496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1169333461-project Jun 24 10:09:06.616496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: method: > Jun 24 10:09:06.616496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: exception: Instance 03050a70-dac3-49b8-a4ab-e73de4421841 could not be found. Jun 24 10:09:06.616496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: action_args: {'id': '03050a70-dac3-49b8-a4ab-e73de4421841'} Jun 24 10:09:06.617461 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:09:06.617461 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:06.617461 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:09:06.617461 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:09:06.617461 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:09:06.617461 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:09:06.617461 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:09:06.617461 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:09:06.617461 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:09:06.617461 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:09:06.617461 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03050a70-dac3-49b8-a4ab-e73de4421841 could not be found. Jun 24 10:09:06.617461 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:09:06.617461 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:09:06.617461 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:09:06.617461 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:06.617461 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:09:06.617461 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:09:06.617461 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:09:06.617461 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:09:06.617461 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:09:06.619172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:09:06.619172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 10:09:06.619172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 10:09:06.619172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 10:09:06.619172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 10:09:06.619172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:09:06.619172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:09:06.619172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:09:06.619172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:09:06.619172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03050a70-dac3-49b8-a4ab-e73de4421841 could not be found. Jun 24 10:09:06.619172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:09:06.619172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:09:06.619172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:09:06.619172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:06.619172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:09:06.619172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:09:06.619172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:09:06.619172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:09:06.619172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03050a70-dac3-49b8-a4ab-e73de4421841 could not be found. Jun 24 10:09:06.619172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:09:06.620956 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-97179273-556e-4a2b-9439-96a8243b8a94 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Returning 404 to user: Instance 03050a70-dac3-49b8-a4ab-e73de4421841 could not be found. {{(pid=124980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:09:06.620956 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-97179273-556e-4a2b-9439-96a8243b8a94 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "DELETE /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 404 len: 111 microversion: 2.20 time: 0.037134 Jun 24 10:09:06.620956 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 446/914] 10.222.0.26 () {60 vars in 1279 bytes} [Fri Jun 24 10:09:06 2022] DELETE /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 10:09:06.627461 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-7aa2cb24-5179-4906-94d8-2f96c7aed8a7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:06.630835 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-7aa2cb24-5179-4906-94d8-2f96c7aed8a7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 03050a70-dac3-49b8-a4ab-e73de4421841] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:06.634648 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7aa2cb24-5179-4906-94d8-2f96c7aed8a7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:06.634966 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a0e5a3ac-b6f3-424a-8e91-ca443005a3e6 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:06.635113 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7aa2cb24-5179-4906-94d8-2f96c7aed8a7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:06.635759 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a0e5a3ac-b6f3-424a-8e91-ca443005a3e6 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:06.635879 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7aa2cb24-5179-4906-94d8-2f96c7aed8a7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:06.636380 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7aa2cb24-5179-4906-94d8-2f96c7aed8a7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:06.637406 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a0e5a3ac-b6f3-424a-8e91-ca443005a3e6 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:06.638241 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a0e5a3ac-b6f3-424a-8e91-ca443005a3e6 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:06.651424 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.wsgi [None req-7aa2cb24-5179-4906-94d8-2f96c7aed8a7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] HTTP exception thrown: Instance 03050a70-dac3-49b8-a4ab-e73de4421841 could not be found. Jun 24 10:09:06.652951 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-7aa2cb24-5179-4906-94d8-2f96c7aed8a7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Request method failure captured: Jun 24 10:09:06.652951 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: request: GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 HTTP/1.1 Jun 24 10:09:06.652951 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept: application/json Jun 24 10:09:06.652951 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept-Encoding: identity Jun 24 10:09:06.652951 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Connection: close Jun 24 10:09:06.652951 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Length: 0 Jun 24 10:09:06.652951 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Type: application/json Jun 24 10:09:06.652951 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Host: 10.222.0.26 Jun 24 10:09:06.652951 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Openstack-System-Scope: None Jun 24 10:09:06.652951 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: User-Agent: python-urllib3/1.26.9 Jun 24 10:09:06.652951 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Auth-Token: gAAAAABitYtjkJw2bHOeZ2cDcfFEKgEvHgE9PcrydC3_0C2_vVDx3RS9Ijzx0RavfKpEzUfBr0snAkOZjXp0ZofsjOoJtHAlurMx_T47sNxT9CHDHEqfOmPfxhcpA_rDpqhSmEtyZVp1ZLcMt9dR4aAJniy9HaUfNPmh-rWZXp0XoJQb88TeRxk Jun 24 10:09:06.652951 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Id: None Jun 24 10:09:06.652951 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Name: None Jun 24 10:09:06.652951 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Identity-Status: Confirmed Jun 24 10:09:06.652951 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Is-Admin-Project: True Jun 24 10:09:06.652951 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 10:09:06.652951 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Id: default Jun 24 10:09:06.652951 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Name: Default Jun 24 10:09:06.652951 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Id: a77797eae68a42639f886f64db5f5598 Jun 24 10:09:06.652951 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1169333461 Jun 24 10:09:06.652951 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Role: reader,member Jun 24 10:09:06.652951 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Roles: reader,member Jun 24 10:09:06.654626 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a77797eae68a42639f886f64db5f5598"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a77797eae68a42639f886f64db5f5598", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a77797eae68a42639f886f64db5f5598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a77797eae68a42639f886f64db5f5598"}]}] Jun 24 10:09:06.654626 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1169333461 Jun 24 10:09:06.654626 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Id: a77797eae68a42639f886f64db5f5598 Jun 24 10:09:06.654626 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1169333461 Jun 24 10:09:06.654626 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User: tempest-AttachVolumeShelveTestJSON-1169333461-project Jun 24 10:09:06.654626 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Id: default Jun 24 10:09:06.654626 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Name: Default Jun 24 10:09:06.654626 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Id: cd894c323c604ed593a01d17092e6c2a Jun 24 10:09:06.654626 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1169333461-project Jun 24 10:09:06.654626 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: method: > Jun 24 10:09:06.654626 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: exception: Instance 03050a70-dac3-49b8-a4ab-e73de4421841 could not be found. Jun 24 10:09:06.654626 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: action_args: {'id': '03050a70-dac3-49b8-a4ab-e73de4421841'} Jun 24 10:09:06.655440 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:09:06.655440 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:06.655440 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:09:06.655440 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:09:06.655440 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:09:06.655440 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:09:06.655440 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:09:06.655440 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:09:06.655440 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:09:06.655440 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:09:06.655440 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03050a70-dac3-49b8-a4ab-e73de4421841 could not be found. Jun 24 10:09:06.655440 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:09:06.655440 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:09:06.655440 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:09:06.655440 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:06.655440 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:09:06.655440 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:09:06.655440 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:09:06.655440 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:09:06.655440 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:09:06.656915 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:09:06.656915 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:09:06.656915 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:09:06.656915 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:09:06.656915 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:09:06.656915 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:09:06.656915 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:09:06.656915 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03050a70-dac3-49b8-a4ab-e73de4421841 could not be found. Jun 24 10:09:06.656915 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:09:06.656915 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:09:06.656915 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:09:06.656915 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:06.656915 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:09:06.656915 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:09:06.656915 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:09:06.656915 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:09:06.656915 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03050a70-dac3-49b8-a4ab-e73de4421841 could not be found. Jun 24 10:09:06.656915 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:09:06.658271 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-7aa2cb24-5179-4906-94d8-2f96c7aed8a7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Returning 404 to user: Instance 03050a70-dac3-49b8-a4ab-e73de4421841 could not be found. {{(pid=124980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:09:06.658271 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-7aa2cb24-5179-4906-94d8-2f96c7aed8a7 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841" status: 404 len: 111 microversion: 2.20 time: 0.031605 Jun 24 10:09:06.658271 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 447/915] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:09:06 2022] GET /compute/v2.1/servers/03050a70-dac3-49b8-a4ab-e73de4421841 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 24 10:09:06.771869 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.objects.instance [None req-a0e5a3ac-b6f3-424a-8e91-ca443005a3e6 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lazy-loading 'services' on Instance uuid f0aef362-32c9-463b-ba31-93ce5c561487 {{(pid=124979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:09:06.995566 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-a0e5a3ac-b6f3-424a-8e91-ca443005a3e6 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487/os-volume_attachments/c9642563-bbed-4a43-8fdd-040832474021" status: 202 len: 0 microversion: 2.1 time: 0.391335 Jun 24 10:09:06.996260 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 469/916] 10.222.0.26 () {58 vars in 1415 bytes} [Fri Jun 24 10:09:06 2022] DELETE /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487/os-volume_attachments/c9642563-bbed-4a43-8fdd-040832474021 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:09:07.005262 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-ad0e2338-3684-46f7-a856-8d72f0130e10 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:07.006481 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-ad0e2338-3684-46f7-a856-8d72f0130e10 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:07.012967 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ad0e2338-3684-46f7-a856-8d72f0130e10 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:07.013431 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ad0e2338-3684-46f7-a856-8d72f0130e10 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:07.014271 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ad0e2338-3684-46f7-a856-8d72f0130e10 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:07.015072 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ad0e2338-3684-46f7-a856-8d72f0130e10 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:07.049814 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-ad0e2338-3684-46f7-a856-8d72f0130e10 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049063 Jun 24 10:09:07.054015 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 448/917] 10.222.0.26 () {58 vars in 1301 bytes} [Fri Jun 24 10:09:06 2022] GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:09:08.015382 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-78b0951d-e90e-4d7d-9599-81bbaccbca7b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:08.015968 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-78b0951d-e90e-4d7d-9599-81bbaccbca7b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:08.023623 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-78b0951d-e90e-4d7d-9599-81bbaccbca7b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:08.024070 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-78b0951d-e90e-4d7d-9599-81bbaccbca7b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:08.025157 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-78b0951d-e90e-4d7d-9599-81bbaccbca7b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:08.025831 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-78b0951d-e90e-4d7d-9599-81bbaccbca7b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:08.041669 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-78b0951d-e90e-4d7d-9599-81bbaccbca7b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] HTTP exception thrown: Instance 904eb348-521e-499e-8127-cb3096230877 could not be found. Jun 24 10:09:08.043398 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-78b0951d-e90e-4d7d-9599-81bbaccbca7b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Request method failure captured: Jun 24 10:09:08.043398 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: DELETE /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 HTTP/1.1 Jun 24 10:09:08.043398 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:09:08.043398 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:09:08.043398 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:09:08.043398 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 0 Jun 24 10:09:08.043398 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:09:08.043398 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:09:08.043398 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:09:08.043398 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:09:08.043398 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitYtjkJw2bHOeZ2cDcfFEKgEvHgE9PcrydC3_0C2_vVDx3RS9Ijzx0RavfKpEzUfBr0snAkOZjXp0ZofsjOoJtHAlurMx_T47sNxT9CHDHEqfOmPfxhcpA_rDpqhSmEtyZVp1ZLcMt9dR4aAJniy9HaUfNPmh-rWZXp0XoJQb88TeRxk Jun 24 10:09:08.043398 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:09:08.043398 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:09:08.043398 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:09:08.043398 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:09:08.043398 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 10:09:08.043398 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:09:08.043398 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:09:08.043398 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: a77797eae68a42639f886f64db5f5598 Jun 24 10:09:08.043398 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1169333461 Jun 24 10:09:08.043398 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:09:08.043398 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:09:08.046146 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a77797eae68a42639f886f64db5f5598"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a77797eae68a42639f886f64db5f5598", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a77797eae68a42639f886f64db5f5598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a77797eae68a42639f886f64db5f5598"}]}] Jun 24 10:09:08.046146 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1169333461 Jun 24 10:09:08.046146 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: a77797eae68a42639f886f64db5f5598 Jun 24 10:09:08.046146 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1169333461 Jun 24 10:09:08.046146 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-AttachVolumeShelveTestJSON-1169333461-project Jun 24 10:09:08.046146 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:09:08.046146 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:09:08.046146 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: cd894c323c604ed593a01d17092e6c2a Jun 24 10:09:08.046146 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1169333461-project Jun 24 10:09:08.046146 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: > Jun 24 10:09:08.046146 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Instance 904eb348-521e-499e-8127-cb3096230877 could not be found. Jun 24 10:09:08.046146 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'id': '904eb348-521e-499e-8127-cb3096230877'} Jun 24 10:09:08.047886 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:09:08.047886 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:08.047886 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:09:08.047886 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:09:08.047886 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:09:08.047886 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:09:08.047886 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:09:08.047886 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:09:08.047886 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:09:08.047886 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:09:08.047886 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 904eb348-521e-499e-8127-cb3096230877 could not be found. Jun 24 10:09:08.047886 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:09:08.047886 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:09:08.047886 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:09:08.047886 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:08.047886 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:09:08.047886 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:09:08.047886 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:09:08.047886 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:09:08.047886 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:09:08.050671 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:09:08.050671 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 10:09:08.050671 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 10:09:08.050671 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 10:09:08.050671 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 10:09:08.050671 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:09:08.050671 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:09:08.050671 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:09:08.050671 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:09:08.050671 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 904eb348-521e-499e-8127-cb3096230877 could not be found. Jun 24 10:09:08.050671 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:09:08.050671 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:09:08.050671 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:09:08.050671 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:08.050671 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:09:08.050671 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:09:08.050671 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:09:08.050671 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:09:08.050671 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 904eb348-521e-499e-8127-cb3096230877 could not be found. Jun 24 10:09:08.050671 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:09:08.052189 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-78b0951d-e90e-4d7d-9599-81bbaccbca7b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Returning 404 to user: Instance 904eb348-521e-499e-8127-cb3096230877 could not be found. {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:09:08.052189 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-78b0951d-e90e-4d7d-9599-81bbaccbca7b tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "DELETE /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 404 len: 111 microversion: 2.20 time: 0.033887 Jun 24 10:09:08.052189 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 470/918] 10.222.0.26 () {60 vars in 1279 bytes} [Fri Jun 24 10:09:08 2022] DELETE /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 24 10:09:08.060030 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-8b48c816-e13c-4fb3-ad5b-5c05a5d38a01 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:08.061277 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-8b48c816-e13c-4fb3-ad5b-5c05a5d38a01 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] [instance: 904eb348-521e-499e-8127-cb3096230877] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:08.065821 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-1472482f-d6e5-4899-9f1c-6ea89664a4c2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:08.066863 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-1472482f-d6e5-4899-9f1c-6ea89664a4c2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:08.073770 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1472482f-d6e5-4899-9f1c-6ea89664a4c2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:08.074227 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1472482f-d6e5-4899-9f1c-6ea89664a4c2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:08.075064 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1472482f-d6e5-4899-9f1c-6ea89664a4c2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:08.075480 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1472482f-d6e5-4899-9f1c-6ea89664a4c2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:08.085331 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8b48c816-e13c-4fb3-ad5b-5c05a5d38a01 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:08.085863 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8b48c816-e13c-4fb3-ad5b-5c05a5d38a01 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:08.086656 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8b48c816-e13c-4fb3-ad5b-5c05a5d38a01 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:08.087092 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8b48c816-e13c-4fb3-ad5b-5c05a5d38a01 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:08.108627 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-1472482f-d6e5-4899-9f1c-6ea89664a4c2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050065 Jun 24 10:09:08.109362 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 471/919] 10.222.0.26 () {58 vars in 1301 bytes} [Fri Jun 24 10:09:08 2022] GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:09:08.110155 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.wsgi [None req-8b48c816-e13c-4fb3-ad5b-5c05a5d38a01 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] HTTP exception thrown: Instance 904eb348-521e-499e-8127-cb3096230877 could not be found. Jun 24 10:09:08.113070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-8b48c816-e13c-4fb3-ad5b-5c05a5d38a01 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Request method failure captured: Jun 24 10:09:08.113070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: request: GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 HTTP/1.1 Jun 24 10:09:08.113070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept: application/json Jun 24 10:09:08.113070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept-Encoding: identity Jun 24 10:09:08.113070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Connection: close Jun 24 10:09:08.113070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Length: 0 Jun 24 10:09:08.113070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Type: application/json Jun 24 10:09:08.113070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Host: 10.222.0.26 Jun 24 10:09:08.113070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Openstack-System-Scope: None Jun 24 10:09:08.113070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: User-Agent: python-urllib3/1.26.9 Jun 24 10:09:08.113070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Auth-Token: gAAAAABitYtjkJw2bHOeZ2cDcfFEKgEvHgE9PcrydC3_0C2_vVDx3RS9Ijzx0RavfKpEzUfBr0snAkOZjXp0ZofsjOoJtHAlurMx_T47sNxT9CHDHEqfOmPfxhcpA_rDpqhSmEtyZVp1ZLcMt9dR4aAJniy9HaUfNPmh-rWZXp0XoJQb88TeRxk Jun 24 10:09:08.113070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Id: None Jun 24 10:09:08.113070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Name: None Jun 24 10:09:08.113070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Identity-Status: Confirmed Jun 24 10:09:08.113070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Is-Admin-Project: True Jun 24 10:09:08.113070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 10:09:08.113070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Id: default Jun 24 10:09:08.113070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Name: Default Jun 24 10:09:08.113070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Id: a77797eae68a42639f886f64db5f5598 Jun 24 10:09:08.113070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1169333461 Jun 24 10:09:08.113070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Role: reader,member Jun 24 10:09:08.113070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Roles: reader,member Jun 24 10:09:08.116279 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a77797eae68a42639f886f64db5f5598"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a77797eae68a42639f886f64db5f5598", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a77797eae68a42639f886f64db5f5598"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a77797eae68a42639f886f64db5f5598"}]}] Jun 24 10:09:08.116279 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1169333461 Jun 24 10:09:08.116279 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Id: a77797eae68a42639f886f64db5f5598 Jun 24 10:09:08.116279 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1169333461 Jun 24 10:09:08.116279 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User: tempest-AttachVolumeShelveTestJSON-1169333461-project Jun 24 10:09:08.116279 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Id: default Jun 24 10:09:08.116279 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Name: Default Jun 24 10:09:08.116279 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Id: cd894c323c604ed593a01d17092e6c2a Jun 24 10:09:08.116279 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1169333461-project Jun 24 10:09:08.116279 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: method: > Jun 24 10:09:08.116279 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: exception: Instance 904eb348-521e-499e-8127-cb3096230877 could not be found. Jun 24 10:09:08.116279 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: action_args: {'id': '904eb348-521e-499e-8127-cb3096230877'} Jun 24 10:09:08.117355 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:09:08.117355 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:08.117355 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:09:08.117355 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:09:08.117355 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:09:08.117355 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:09:08.117355 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:09:08.117355 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:09:08.117355 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:09:08.117355 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:09:08.117355 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 904eb348-521e-499e-8127-cb3096230877 could not be found. Jun 24 10:09:08.117355 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:09:08.117355 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:09:08.117355 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:09:08.117355 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:08.117355 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:09:08.117355 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:09:08.117355 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:09:08.117355 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:09:08.117355 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:09:08.118673 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:09:08.118673 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:09:08.118673 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:09:08.118673 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:09:08.118673 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:09:08.118673 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:09:08.118673 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:09:08.118673 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 904eb348-521e-499e-8127-cb3096230877 could not be found. Jun 24 10:09:08.118673 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:09:08.118673 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:09:08.118673 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:09:08.118673 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:08.118673 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:09:08.118673 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:09:08.118673 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:09:08.118673 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:09:08.118673 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 904eb348-521e-499e-8127-cb3096230877 could not be found. Jun 24 10:09:08.118673 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:09:08.119916 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-8b48c816-e13c-4fb3-ad5b-5c05a5d38a01 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] Returning 404 to user: Instance 904eb348-521e-499e-8127-cb3096230877 could not be found. {{(pid=124980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:09:08.119916 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-8b48c816-e13c-4fb3-ad5b-5c05a5d38a01 tempest-AttachVolumeShelveTestJSON-1169333461 tempest-AttachVolumeShelveTestJSON-1169333461-project] 10.222.0.26 "GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877" status: 404 len: 111 microversion: 2.20 time: 0.062387 Jun 24 10:09:08.119916 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 449/920] 10.222.0.26 () {60 vars in 1276 bytes} [Fri Jun 24 10:09:08 2022] GET /compute/v2.1/servers/904eb348-521e-499e-8127-cb3096230877 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 10:09:09.120454 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-d2f4819f-b48d-48cf-8360-b54018cd1519 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:09.121494 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-d2f4819f-b48d-48cf-8360-b54018cd1519 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:09.129409 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d2f4819f-b48d-48cf-8360-b54018cd1519 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:09.129876 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d2f4819f-b48d-48cf-8360-b54018cd1519 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:09.130962 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d2f4819f-b48d-48cf-8360-b54018cd1519 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:09.131400 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d2f4819f-b48d-48cf-8360-b54018cd1519 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:09.165295 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-d2f4819f-b48d-48cf-8360-b54018cd1519 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048928 Jun 24 10:09:09.165884 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 472/921] 10.222.0.26 () {58 vars in 1301 bytes} [Fri Jun 24 10:09:09 2022] GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 10:09:09.229307 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-f48ffb48-d359-4062-a183-4ccb2cb77477 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:09.230065 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-f48ffb48-d359-4062-a183-4ccb2cb77477 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:09.237868 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f48ffb48-d359-4062-a183-4ccb2cb77477 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:09.238318 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f48ffb48-d359-4062-a183-4ccb2cb77477 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:09.239101 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f48ffb48-d359-4062-a183-4ccb2cb77477 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:09.240824 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f48ffb48-d359-4062-a183-4ccb2cb77477 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:09.274907 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-f48ffb48-d359-4062-a183-4ccb2cb77477 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Going to try to terminate instance {{(pid=124980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:09:09.783852 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-f48ffb48-d359-4062-a183-4ccb2cb77477 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487" status: 204 len: 0 microversion: 2.1 time: 0.557713 Jun 24 10:09:09.785465 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 450/922] 10.222.0.26 () {58 vars in 1238 bytes} [Fri Jun 24 10:09:09 2022] DELETE /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:09:09.793156 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-bd29e3f5-d4c2-4e40-8ef2-4d3bdc2cc51e tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:09.794086 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-bd29e3f5-d4c2-4e40-8ef2-4d3bdc2cc51e tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:09.802043 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-bd29e3f5-d4c2-4e40-8ef2-4d3bdc2cc51e tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:09.802800 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-bd29e3f5-d4c2-4e40-8ef2-4d3bdc2cc51e tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:09.803791 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-bd29e3f5-d4c2-4e40-8ef2-4d3bdc2cc51e tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:09.804442 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-bd29e3f5-d4c2-4e40-8ef2-4d3bdc2cc51e tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:10.085514 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-bd29e3f5-d4c2-4e40-8ef2-4d3bdc2cc51e tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:10.093843 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-bd29e3f5-d4c2-4e40-8ef2-4d3bdc2cc51e tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487" status: 200 len: 1681 microversion: 2.1 time: 0.304566 Jun 24 10:09:10.094429 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 473/923] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:09:09 2022] GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487 => generated 1681 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:09:11.118385 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-2d388fbc-37ef-420a-a794-9c0a73cb6094 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:11.119941 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-2d388fbc-37ef-420a-a794-9c0a73cb6094 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:11.135168 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2d388fbc-37ef-420a-a794-9c0a73cb6094 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:11.136465 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2d388fbc-37ef-420a-a794-9c0a73cb6094 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:11.138531 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2d388fbc-37ef-420a-a794-9c0a73cb6094 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:11.139340 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2d388fbc-37ef-420a-a794-9c0a73cb6094 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:11.393866 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2d388fbc-37ef-420a-a794-9c0a73cb6094 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:11.409472 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-2d388fbc-37ef-420a-a794-9c0a73cb6094 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487" status: 200 len: 1681 microversion: 2.1 time: 0.299289 Jun 24 10:09:11.411099 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 451/924] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:09:11 2022] GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487 => generated 1681 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:09:12.435055 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-64a809bb-fa5c-4e44-957c-87b5e4f84084 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:12.435841 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-64a809bb-fa5c-4e44-957c-87b5e4f84084 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:12.445048 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-64a809bb-fa5c-4e44-957c-87b5e4f84084 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:12.445513 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-64a809bb-fa5c-4e44-957c-87b5e4f84084 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:12.446314 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-64a809bb-fa5c-4e44-957c-87b5e4f84084 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:12.446751 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-64a809bb-fa5c-4e44-957c-87b5e4f84084 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:12.644490 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-64a809bb-fa5c-4e44-957c-87b5e4f84084 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:12.658947 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-64a809bb-fa5c-4e44-957c-87b5e4f84084 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487" status: 200 len: 1681 microversion: 2.1 time: 0.229142 Jun 24 10:09:12.659581 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 474/925] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:09:12 2022] GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487 => generated 1681 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:09:13.687942 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-b6eaa18c-810d-4bb3-9c83-1e466f477d9a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:13.689975 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-b6eaa18c-810d-4bb3-9c83-1e466f477d9a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:13.702773 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b6eaa18c-810d-4bb3-9c83-1e466f477d9a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:13.703765 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b6eaa18c-810d-4bb3-9c83-1e466f477d9a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:13.705145 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b6eaa18c-810d-4bb3-9c83-1e466f477d9a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:13.705876 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b6eaa18c-810d-4bb3-9c83-1e466f477d9a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:13.729711 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:09:13.868685 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-b6eaa18c-810d-4bb3-9c83-1e466f477d9a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:13.883859 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-b6eaa18c-810d-4bb3-9c83-1e466f477d9a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487" status: 200 len: 1614 microversion: 2.1 time: 0.201585 Jun 24 10:09:13.892415 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 452/926] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:09:13 2022] GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487 => generated 1614 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:09:14.021445 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-ca272d60-beba-4797-9ff5-58ea36919eb8 req-28d67e11-d430-4953-a8b0-e7ee7c8fd3f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0aef362-32c9-463b-ba31-93ce5c561487", "name": "network-vif-deleted", "tag": "c19c9d2a-aac2-4d52-be49-eee68aeee93f"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:09:14.041603 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-ca272d60-beba-4797-9ff5-58ea36919eb8 req-28d67e11-d430-4953-a8b0-e7ee7c8fd3f4 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:14.042613 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-ca272d60-beba-4797-9ff5-58ea36919eb8 req-28d67e11-d430-4953-a8b0-e7ee7c8fd3f4 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:14.071851 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-ca272d60-beba-4797-9ff5-58ea36919eb8 req-28d67e11-d430-4953-a8b0-e7ee7c8fd3f4 service nova] Creating event network-vif-deleted:c19c9d2a-aac2-4d52-be49-eee68aeee93f for instance f0aef362-32c9-463b-ba31-93ce5c561487 on hv-cinder-84327 Jun 24 10:09:14.093156 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-ca272d60-beba-4797-9ff5-58ea36919eb8 req-28d67e11-d430-4953-a8b0-e7ee7c8fd3f4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076698 Jun 24 10:09:14.098885 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 475/927] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:09:14.915055 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-59208f08-ae98-4b72-a1a8-4e8a7d4b3a98 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:14.917176 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-59208f08-ae98-4b72-a1a8-4e8a7d4b3a98 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:14.929233 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-59208f08-ae98-4b72-a1a8-4e8a7d4b3a98 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:14.930407 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-59208f08-ae98-4b72-a1a8-4e8a7d4b3a98 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:14.932297 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-59208f08-ae98-4b72-a1a8-4e8a7d4b3a98 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:14.932838 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-59208f08-ae98-4b72-a1a8-4e8a7d4b3a98 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:15.004439 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-59208f08-ae98-4b72-a1a8-4e8a7d4b3a98 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:15.005742 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-59208f08-ae98-4b72-a1a8-4e8a7d4b3a98 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:15.007085 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.objects.instance [None req-59208f08-ae98-4b72-a1a8-4e8a7d4b3a98 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lazy-loading 'fault' on Instance uuid f0aef362-32c9-463b-ba31-93ce5c561487 {{(pid=124980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:09:15.117821 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-59208f08-ae98-4b72-a1a8-4e8a7d4b3a98 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:15.127303 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-59208f08-ae98-4b72-a1a8-4e8a7d4b3a98 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487" status: 200 len: 1331 microversion: 2.1 time: 0.220151 Jun 24 10:09:15.131109 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 453/928] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:09:14 2022] GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487 => generated 1331 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:09:16.154213 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-8c2a1265-ffd6-4d0a-afbb-97c472532807 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:16.155021 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-8c2a1265-ffd6-4d0a-afbb-97c472532807 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:16.162293 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8c2a1265-ffd6-4d0a-afbb-97c472532807 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:16.162699 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8c2a1265-ffd6-4d0a-afbb-97c472532807 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:16.163525 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8c2a1265-ffd6-4d0a-afbb-97c472532807 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:16.164003 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-8c2a1265-ffd6-4d0a-afbb-97c472532807 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:16.169081 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:09:16.187215 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-8c2a1265-ffd6-4d0a-afbb-97c472532807 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] HTTP exception thrown: Instance f0aef362-32c9-463b-ba31-93ce5c561487 could not be found. Jun 24 10:09:16.190786 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-8c2a1265-ffd6-4d0a-afbb-97c472532807 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Request method failure captured: Jun 24 10:09:16.190786 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487 HTTP/1.1 Jun 24 10:09:16.190786 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:09:16.190786 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:09:16.190786 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:09:16.190786 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 0 Jun 24 10:09:16.190786 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:09:16.190786 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:09:16.190786 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:09:16.190786 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:09:16.190786 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitYyzKx6mxHcouBd786V7PSRKtqG7vQygoeml9ZFRI4t-s7SskaI_N7VnM2cMTHq18lI9OepR13ZTFpIKllTjNCYBqowBTJBvubT2uG08oWBo29qBWawe6q0x1WdImPCEss3dF17N9x8N3_7uAMt0BoG5BjapetFSeerYUrODzwv3CBQ Jun 24 10:09:16.190786 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:09:16.190786 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:09:16.190786 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:09:16.190786 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:09:16.190786 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:09:16.190786 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:09:16.190786 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: 64b655c9ef0948c099f60649b9d5e78d Jun 24 10:09:16.190786 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:09:16.190786 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:09:16.190786 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:09:16.194099 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/64b655c9ef0948c099f60649b9d5e78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_64b655c9ef0948c099f60649b9d5e78d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/64b655c9ef0948c099f60649b9d5e78d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/64b655c9ef0948c099f60649b9d5e78d"}]}] Jun 24 10:09:16.194099 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:09:16.194099 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: 64b655c9ef0948c099f60649b9d5e78d Jun 24 10:09:16.194099 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:09:16.194099 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-AttachVolumeNegativeTest-1676240271-project Jun 24 10:09:16.194099 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:09:16.194099 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:09:16.194099 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: f2c97e68f66142f9b502b215313f7e80 Jun 24 10:09:16.194099 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-AttachVolumeNegativeTest-1676240271-project Jun 24 10:09:16.194099 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: > Jun 24 10:09:16.194099 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Instance f0aef362-32c9-463b-ba31-93ce5c561487 could not be found. Jun 24 10:09:16.194099 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'id': 'f0aef362-32c9-463b-ba31-93ce5c561487'} Jun 24 10:09:16.196385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:09:16.196385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:16.196385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:09:16.196385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:09:16.196385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:09:16.196385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:09:16.196385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:09:16.196385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:09:16.196385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:09:16.196385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:09:16.196385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0aef362-32c9-463b-ba31-93ce5c561487 could not be found. Jun 24 10:09:16.196385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:09:16.196385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:09:16.196385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:09:16.196385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:16.196385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:09:16.196385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:09:16.196385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:09:16.196385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:09:16.196385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:09:16.205972 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:09:16.205972 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:09:16.205972 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:09:16.205972 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:09:16.205972 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:09:16.205972 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:09:16.205972 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:09:16.205972 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0aef362-32c9-463b-ba31-93ce5c561487 could not be found. Jun 24 10:09:16.205972 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:09:16.205972 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:09:16.205972 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:09:16.205972 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:16.205972 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:09:16.205972 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:09:16.205972 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:09:16.205972 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:09:16.205972 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0aef362-32c9-463b-ba31-93ce5c561487 could not be found. Jun 24 10:09:16.205972 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:09:16.208394 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-8c2a1265-ffd6-4d0a-afbb-97c472532807 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Returning 404 to user: Instance f0aef362-32c9-463b-ba31-93ce5c561487 could not be found. {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:09:16.208394 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-8c2a1265-ffd6-4d0a-afbb-97c472532807 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487" status: 404 len: 111 microversion: 2.1 time: 0.044378 Jun 24 10:09:16.208394 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 476/929] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:09:16 2022] GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:09:16.208809 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-c78f38b7-8dbf-49eb-a6af-f85fa6b0db22 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '.version_select at 0x7f0309ab3940>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:16.461197 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-c78f38b7-8dbf-49eb-a6af-f85fa6b0db22 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1603570819" status: 202 len: 0 microversion: 2.1 time: 0.259766 Jun 24 10:09:16.461951 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 454/930] 10.222.0.26 () {58 vars in 1220 bytes} [Fri Jun 24 10:09:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1603570819 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:09:17.679265 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-c96a978f-bf18-4242-bea7-b33a117181a8 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Action: 'create', calling method: .version_select at 0x7f0309e8b820>, body: {"keypair": {"name": "tempest-keypair-1859864998", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmbzLTH2E7BRU/yBP/TeDICdCZJcRLQnEuXqEuMBMLaEo26Pu4lKOAGLjpJyEFY3ZkZuJOageza8YNf65HURgw146Wlm3nVghwLjZ/b0OQQupmgi1carvkNMH38iJ7/uw=="}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:09:17.697973 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-c96a978f-bf18-4242-bea7-b33a117181a8 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Getting quotas for project 64b655c9ef0948c099f60649b9d5e78d. Resources: {'key_pairs'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:09:17.704020 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-c96a978f-bf18-4242-bea7-b33a117181a8 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Getting quotas for user f2c97e68f66142f9b502b215313f7e80 and project 64b655c9ef0948c099f60649b9d5e78d. Resources: {'key_pairs'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:09:17.913019 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-c96a978f-bf18-4242-bea7-b33a117181a8 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.239445 Jun 24 10:09:17.913449 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 477/931] 10.222.0.26 () {60 vars in 1158 bytes} [Fri Jun 24 10:09:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:09:21.583263 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-424f89be-9b08-4dae-a7c1-e97de8e3da51 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-926916564", "imageRef": "f6b1dddb-2953-41a2-99e3-00aeca441bd9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c1a62ba-de23-4693-a76a-ab88e859eb34"}], "security_groups": [{"name": "tempest-securitygroup--1499382473"}], "key_name": "tempest-keypair-1859864998", "user_data": "}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:09:21.716824 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.network.neutron [None req-424f89be-9b08-4dae-a7c1-e97de8e3da51 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] validate_networks() for [('2c1a62ba-de23-4693-a76a-ab88e859eb34', None, None, None, None, None)] {{(pid=124980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:09:22.432984 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-424f89be-9b08-4dae-a7c1-e97de8e3da51 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Flavor limits 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:09:22.436391 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-424f89be-9b08-4dae-a7c1-e97de8e3da51 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Image limits 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:09:22.436391 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-424f89be-9b08-4dae-a7c1-e97de8e3da51 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Flavor pref 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:09:22.437024 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-424f89be-9b08-4dae-a7c1-e97de8e3da51 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Image pref 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:09:22.438417 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-424f89be-9b08-4dae-a7c1-e97de8e3da51 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:09:22.460349 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-424f89be-9b08-4dae-a7c1-e97de8e3da51 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:22.460349 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-424f89be-9b08-4dae-a7c1-e97de8e3da51 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:22.460349 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-424f89be-9b08-4dae-a7c1-e97de8e3da51 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:22.460775 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-424f89be-9b08-4dae-a7c1-e97de8e3da51 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:22.493927 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-424f89be-9b08-4dae-a7c1-e97de8e3da51 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Getting quotas for project 64b655c9ef0948c099f60649b9d5e78d. Resources: {'instances', 'cores', 'ram'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:09:22.501935 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-424f89be-9b08-4dae-a7c1-e97de8e3da51 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Getting quotas for user f2c97e68f66142f9b502b215313f7e80 and project 64b655c9ef0948c099f60649b9d5e78d. Resources: {'instances', 'cores', 'ram'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:09:22.522715 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-424f89be-9b08-4dae-a7c1-e97de8e3da51 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Going to run 1 instances... {{(pid=124980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:09:22.527070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-424f89be-9b08-4dae-a7c1-e97de8e3da51 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6b1dddb-2953-41a2-99e3-00aeca441bd9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:09:22.711624 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-424f89be-9b08-4dae-a7c1-e97de8e3da51 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.133029 Jun 24 10:09:22.713349 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 455/932] 10.222.0.26 () {60 vars in 1146 bytes} [Fri Jun 24 10:09:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:09:22.728109 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-e5eca9fb-459a-403c-b47f-b686443a6abc tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:22.729108 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-e5eca9fb-459a-403c-b47f-b686443a6abc tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:22.841967 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-e5eca9fb-459a-403c-b47f-b686443a6abc tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:22.858816 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-e5eca9fb-459a-403c-b47f-b686443a6abc tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123" status: 200 len: 1241 microversion: 2.1 time: 0.138008 Jun 24 10:09:22.859788 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 478/933] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:09:22 2022] GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123 => generated 1241 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:09:23.881545 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-8b3447ef-436b-4e53-8074-c36584879c24 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:23.882626 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-8b3447ef-436b-4e53-8074-c36584879c24 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:23.893927 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8b3447ef-436b-4e53-8074-c36584879c24 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:23.894923 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8b3447ef-436b-4e53-8074-c36584879c24 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:23.904165 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8b3447ef-436b-4e53-8074-c36584879c24 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:23.904165 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8b3447ef-436b-4e53-8074-c36584879c24 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:24.011570 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-8b3447ef-436b-4e53-8074-c36584879c24 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:24.019959 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-8b3447ef-436b-4e53-8074-c36584879c24 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123" status: 200 len: 1245 microversion: 2.1 time: 0.145375 Jun 24 10:09:24.020742 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 456/934] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:09:23 2022] GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123 => generated 1245 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:09:25.038929 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-a711b776-54c5-41b6-9686-6d2591213f21 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:25.040189 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-a711b776-54c5-41b6-9686-6d2591213f21 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:25.049163 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a711b776-54c5-41b6-9686-6d2591213f21 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:25.049884 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a711b776-54c5-41b6-9686-6d2591213f21 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:25.051190 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a711b776-54c5-41b6-9686-6d2591213f21 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:25.052527 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a711b776-54c5-41b6-9686-6d2591213f21 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:25.179887 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-a711b776-54c5-41b6-9686-6d2591213f21 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:25.195372 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-a711b776-54c5-41b6-9686-6d2591213f21 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123" status: 200 len: 1293 microversion: 2.1 time: 0.159960 Jun 24 10:09:25.196074 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 479/935] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:09:25 2022] GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123 => generated 1293 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:09:26.231530 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-33277b98-44af-4d27-947f-2de8d94e516f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:26.234079 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-33277b98-44af-4d27-947f-2de8d94e516f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:26.244816 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-33277b98-44af-4d27-947f-2de8d94e516f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:26.245724 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-33277b98-44af-4d27-947f-2de8d94e516f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:26.247019 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-33277b98-44af-4d27-947f-2de8d94e516f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:26.247779 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-33277b98-44af-4d27-947f-2de8d94e516f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:26.409755 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-33277b98-44af-4d27-947f-2de8d94e516f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:26.422203 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-33277b98-44af-4d27-947f-2de8d94e516f tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123" status: 200 len: 1299 microversion: 2.1 time: 0.198598 Jun 24 10:09:26.436630 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 457/936] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:09:26 2022] GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123 => generated 1299 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:09:27.458363 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-733d8f1c-a07e-450f-abf4-67b0f37355ff tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:27.459988 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-733d8f1c-a07e-450f-abf4-67b0f37355ff tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:27.471082 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-733d8f1c-a07e-450f-abf4-67b0f37355ff tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:27.471757 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-733d8f1c-a07e-450f-abf4-67b0f37355ff tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:27.472903 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-733d8f1c-a07e-450f-abf4-67b0f37355ff tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:27.473503 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-733d8f1c-a07e-450f-abf4-67b0f37355ff tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:27.769558 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-733d8f1c-a07e-450f-abf4-67b0f37355ff tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:27.787519 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-733d8f1c-a07e-450f-abf4-67b0f37355ff tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123" status: 200 len: 1367 microversion: 2.1 time: 0.341497 Jun 24 10:09:27.788772 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 480/937] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:09:27 2022] GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123 => generated 1367 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:09:28.522954 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-a07847bd-39b1-4b8b-8c95-46cb48ce123b req-8b8124c8-bc23-4d7f-bbad-55c120443659 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be64c134-2849-4168-8e6d-ba3cef4f3123", "tag": "ac624c3b-2da8-4c77-aee5-62a4ad7e74b0"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:09:28.530343 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:09:28.540938 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-a07847bd-39b1-4b8b-8c95-46cb48ce123b req-8b8124c8-bc23-4d7f-bbad-55c120443659 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:28.542210 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-a07847bd-39b1-4b8b-8c95-46cb48ce123b req-8b8124c8-bc23-4d7f-bbad-55c120443659 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:28.567843 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-a07847bd-39b1-4b8b-8c95-46cb48ce123b req-8b8124c8-bc23-4d7f-bbad-55c120443659 service nova] Creating event network-changed:ac624c3b-2da8-4c77-aee5-62a4ad7e74b0 for instance be64c134-2849-4168-8e6d-ba3cef4f3123 on hv-cinder-84327 Jun 24 10:09:28.578630 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-a07847bd-39b1-4b8b-8c95-46cb48ce123b req-8b8124c8-bc23-4d7f-bbad-55c120443659 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059378 Jun 24 10:09:28.580574 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 458/938] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:09:28.824107 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-5a215e53-c9b2-47e7-ba07-50e3106e180b tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:28.827001 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-5a215e53-c9b2-47e7-ba07-50e3106e180b tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:28.834338 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:09:28.837530 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5a215e53-c9b2-47e7-ba07-50e3106e180b tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:28.838894 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5a215e53-c9b2-47e7-ba07-50e3106e180b tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:28.839750 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5a215e53-c9b2-47e7-ba07-50e3106e180b tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:28.840229 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5a215e53-c9b2-47e7-ba07-50e3106e180b tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:29.082299 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-5a215e53-c9b2-47e7-ba07-50e3106e180b tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:29.096805 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-5a215e53-c9b2-47e7-ba07-50e3106e180b tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123" status: 200 len: 1367 microversion: 2.1 time: 0.284027 Jun 24 10:09:29.113474 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 481/939] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:09:28 2022] GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123 => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:09:30.128033 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-7e6ccf7e-e727-493d-b05a-4c7cc46865b2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:30.129133 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-7e6ccf7e-e727-493d-b05a-4c7cc46865b2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:30.138878 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7e6ccf7e-e727-493d-b05a-4c7cc46865b2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:30.139466 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7e6ccf7e-e727-493d-b05a-4c7cc46865b2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:30.140660 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7e6ccf7e-e727-493d-b05a-4c7cc46865b2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:30.141204 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7e6ccf7e-e727-493d-b05a-4c7cc46865b2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:30.352601 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-7e6ccf7e-e727-493d-b05a-4c7cc46865b2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:30.364753 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-7e6ccf7e-e727-493d-b05a-4c7cc46865b2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123" status: 200 len: 1367 microversion: 2.1 time: 0.244123 Jun 24 10:09:30.365745 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 459/940] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:09:30 2022] GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:09:31.387613 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-433281bb-63e2-40ec-97ec-28a98bbcf123 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:31.388821 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-433281bb-63e2-40ec-97ec-28a98bbcf123 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:31.401220 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-433281bb-63e2-40ec-97ec-28a98bbcf123 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:31.401972 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-433281bb-63e2-40ec-97ec-28a98bbcf123 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:31.403274 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-433281bb-63e2-40ec-97ec-28a98bbcf123 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:31.403951 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-433281bb-63e2-40ec-97ec-28a98bbcf123 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:31.622637 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-433281bb-63e2-40ec-97ec-28a98bbcf123 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:31.635588 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-433281bb-63e2-40ec-97ec-28a98bbcf123 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123" status: 200 len: 1367 microversion: 2.1 time: 0.255770 Jun 24 10:09:31.636199 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 482/941] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:09:31 2022] GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123 => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:09:32.657491 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-ce645d0e-480a-4a82-891f-40065f8936d7 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:32.658796 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-ce645d0e-480a-4a82-891f-40065f8936d7 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:32.663693 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell0:SELECT=2 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:09:32.664962 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell0:SELECT=6 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:09:32.676661 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ce645d0e-480a-4a82-891f-40065f8936d7 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:32.677451 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ce645d0e-480a-4a82-891f-40065f8936d7 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:32.678633 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ce645d0e-480a-4a82-891f-40065f8936d7 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:32.679414 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ce645d0e-480a-4a82-891f-40065f8936d7 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:32.891498 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-ce645d0e-480a-4a82-891f-40065f8936d7 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:32.903854 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-ce645d0e-480a-4a82-891f-40065f8936d7 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123" status: 200 len: 1367 microversion: 2.1 time: 0.253677 Jun 24 10:09:32.904855 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 460/942] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:09:32 2022] GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123 => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:09:33.932115 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-f510eb5b-bdcf-4ae9-8290-e1213a2066c3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:33.933226 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-f510eb5b-bdcf-4ae9-8290-e1213a2066c3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:33.938725 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell0:SELECT=6 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:09:33.947698 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f510eb5b-bdcf-4ae9-8290-e1213a2066c3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:33.948189 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f510eb5b-bdcf-4ae9-8290-e1213a2066c3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:33.948995 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f510eb5b-bdcf-4ae9-8290-e1213a2066c3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:33.949437 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f510eb5b-bdcf-4ae9-8290-e1213a2066c3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:34.133110 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-f510eb5b-bdcf-4ae9-8290-e1213a2066c3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:34.141226 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-f510eb5b-bdcf-4ae9-8290-e1213a2066c3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123" status: 200 len: 1367 microversion: 2.1 time: 0.216912 Jun 24 10:09:34.141827 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 483/943] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:09:33 2022] GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:09:34.591090 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-c618e039-6084-4ce3-bcc9-23f3a18ee9a7 req-7fd9d356-9fc6-4598-b1a7-f30f1a633d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be64c134-2849-4168-8e6d-ba3cef4f3123", "name": "network-vif-plugged", "status": "completed", "tag": "ac624c3b-2da8-4c77-aee5-62a4ad7e74b0"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:09:34.607755 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-c618e039-6084-4ce3-bcc9-23f3a18ee9a7 req-7fd9d356-9fc6-4598-b1a7-f30f1a633d3c service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:34.608580 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-c618e039-6084-4ce3-bcc9-23f3a18ee9a7 req-7fd9d356-9fc6-4598-b1a7-f30f1a633d3c service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:34.629546 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-c618e039-6084-4ce3-bcc9-23f3a18ee9a7 req-7fd9d356-9fc6-4598-b1a7-f30f1a633d3c service nova] Creating event network-vif-plugged:ac624c3b-2da8-4c77-aee5-62a4ad7e74b0 for instance be64c134-2849-4168-8e6d-ba3cef4f3123 on hv-cinder-84327 Jun 24 10:09:34.637402 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-c618e039-6084-4ce3-bcc9-23f3a18ee9a7 req-7fd9d356-9fc6-4598-b1a7-f30f1a633d3c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052618 Jun 24 10:09:34.638367 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 461/944] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:09:35.162664 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-10342cca-f6fc-4f34-9886-af4e383a5f50 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:35.163467 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-10342cca-f6fc-4f34-9886-af4e383a5f50 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:35.170435 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-10342cca-f6fc-4f34-9886-af4e383a5f50 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:35.170885 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-10342cca-f6fc-4f34-9886-af4e383a5f50 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:35.171666 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-10342cca-f6fc-4f34-9886-af4e383a5f50 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:35.172103 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-10342cca-f6fc-4f34-9886-af4e383a5f50 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:35.334421 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-10342cca-f6fc-4f34-9886-af4e383a5f50 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:35.343984 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-10342cca-f6fc-4f34-9886-af4e383a5f50 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123" status: 200 len: 1367 microversion: 2.1 time: 0.188246 Jun 24 10:09:35.345444 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 484/945] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:09:35 2022] GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:09:36.371440 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-bf42f749-96f6-4aeb-8db8-9bc51242ed00 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:36.372177 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-bf42f749-96f6-4aeb-8db8-9bc51242ed00 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:36.378924 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-bf42f749-96f6-4aeb-8db8-9bc51242ed00 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:36.379375 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-bf42f749-96f6-4aeb-8db8-9bc51242ed00 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:36.380229 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-bf42f749-96f6-4aeb-8db8-9bc51242ed00 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:36.380692 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-bf42f749-96f6-4aeb-8db8-9bc51242ed00 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:36.560253 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-bf42f749-96f6-4aeb-8db8-9bc51242ed00 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:36.574020 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-bf42f749-96f6-4aeb-8db8-9bc51242ed00 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123" status: 200 len: 1367 microversion: 2.1 time: 0.209868 Jun 24 10:09:36.575024 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 462/946] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:09:36 2022] GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:09:36.611951 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:09:36.612847 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Fri Jun 24 10:09:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:09:37.597839 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-ef9c0cd8-1b10-4396-9a30-bd38170556c2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:37.598468 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-ef9c0cd8-1b10-4396-9a30-bd38170556c2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:37.605898 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ef9c0cd8-1b10-4396-9a30-bd38170556c2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:37.606360 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ef9c0cd8-1b10-4396-9a30-bd38170556c2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:37.607143 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ef9c0cd8-1b10-4396-9a30-bd38170556c2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:37.607611 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ef9c0cd8-1b10-4396-9a30-bd38170556c2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:37.749307 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-ef9c0cd8-1b10-4396-9a30-bd38170556c2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:09:37.757120 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-ef9c0cd8-1b10-4396-9a30-bd38170556c2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123" status: 200 len: 1558 microversion: 2.1 time: 0.166186 Jun 24 10:09:37.757700 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 485/947] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:09:37 2022] GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123 => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:09:37.779871 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-7cdce447-831b-42ab-ab65-42c15361ee71 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:37.780855 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-7cdce447-831b-42ab-ab65-42c15361ee71 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:09:37.791298 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7cdce447-831b-42ab-ab65-42c15361ee71 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:37.791632 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7cdce447-831b-42ab-ab65-42c15361ee71 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:37.792668 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7cdce447-831b-42ab-ab65-42c15361ee71 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:37.793238 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7cdce447-831b-42ab-ab65-42c15361ee71 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:37.887963 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-7cdce447-831b-42ab-ab65-42c15361ee71 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.111999 Jun 24 10:09:37.888594 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 463/948] 10.222.0.26 () {58 vars in 1274 bytes} [Fri Jun 24 10:09:37 2022] GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:09:39.376590 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-32d5e778-22af-4782-ab55-0e5ca3e43303 req-9f058f63-514d-4581-a60d-c4a58335e5cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be64c134-2849-4168-8e6d-ba3cef4f3123", "tag": "ac624c3b-2da8-4c77-aee5-62a4ad7e74b0"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:09:39.386902 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-32d5e778-22af-4782-ab55-0e5ca3e43303 req-9f058f63-514d-4581-a60d-c4a58335e5cf service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:09:39.387340 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-32d5e778-22af-4782-ab55-0e5ca3e43303 req-9f058f63-514d-4581-a60d-c4a58335e5cf service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:09:39.399682 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-32d5e778-22af-4782-ab55-0e5ca3e43303 req-9f058f63-514d-4581-a60d-c4a58335e5cf service nova] Creating event network-changed:ac624c3b-2da8-4c77-aee5-62a4ad7e74b0 for instance be64c134-2849-4168-8e6d-ba3cef4f3123 on hv-cinder-84327 Jun 24 10:09:39.405380 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-32d5e778-22af-4782-ab55-0e5ca3e43303 req-9f058f63-514d-4581-a60d-c4a58335e5cf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033149 Jun 24 10:09:39.406015 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 486/949] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:10:15.558004 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_api:SELECT=11 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:10:15.558760 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=52 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:10:15.563495 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-3d27871e-2c15-4eca-b4bd-eec4302893d3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:15.563993 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-3d27871e-2c15-4eca-b4bd-eec4302893d3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:15.570133 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3d27871e-2c15-4eca-b4bd-eec4302893d3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:15.570589 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3d27871e-2c15-4eca-b4bd-eec4302893d3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:15.571374 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3d27871e-2c15-4eca-b4bd-eec4302893d3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:15.571819 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3d27871e-2c15-4eca-b4bd-eec4302893d3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:15.597805 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-3d27871e-2c15-4eca-b4bd-eec4302893d3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123/ips" status: 200 len: 150 microversion: 2.1 time: 0.041605 Jun 24 10:10:15.598392 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 464/950] 10.222.0.26 () {58 vars in 1247 bytes} [Fri Jun 24 10:10:15 2022] GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:10:17.506317 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_api:SELECT=11 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:10:17.507312 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=44 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:10:17.511957 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-09a5ecee-99c8-4c75-863d-ef7e2098bc95 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5c48d27-d396-4e90-ba16-d29dbd6bb4e1"}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:10:17.513454 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-09a5ecee-99c8-4c75-863d-ef7e2098bc95 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:17.521705 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-09a5ecee-99c8-4c75-863d-ef7e2098bc95 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:17.522156 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-09a5ecee-99c8-4c75-863d-ef7e2098bc95 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:17.522989 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-09a5ecee-99c8-4c75-863d-ef7e2098bc95 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:17.523415 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-09a5ecee-99c8-4c75-863d-ef7e2098bc95 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:18.604752 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-09a5ecee-99c8-4c75-863d-ef7e2098bc95 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "POST /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.100029 Jun 24 10:10:18.605467 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 487/951] 10.222.0.26 () {60 vars in 1322 bytes} [Fri Jun 24 10:10:17 2022] POST /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123/os-volume_attachments => generated 194 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:10:27.255703 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-e2fafbd7-d59e-44fe-9ce6-138d12a3982a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5c48d27-d396-4e90-ba16-d29dbd6bb4e1"}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:10:27.256835 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-e2fafbd7-d59e-44fe-9ce6-138d12a3982a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:27.264314 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e2fafbd7-d59e-44fe-9ce6-138d12a3982a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:27.264789 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e2fafbd7-d59e-44fe-9ce6-138d12a3982a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:27.265584 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e2fafbd7-d59e-44fe-9ce6-138d12a3982a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:27.266025 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e2fafbd7-d59e-44fe-9ce6-138d12a3982a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:27.386563 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.wsgi [None req-e2fafbd7-d59e-44fe-9ce6-138d12a3982a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] HTTP exception thrown: Invalid volume: volume c5c48d27-d396-4e90-ba16-d29dbd6bb4e1 is already attached to instances: be64c134-2849-4168-8e6d-ba3cef4f3123 Jun 24 10:10:27.391046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-e2fafbd7-d59e-44fe-9ce6-138d12a3982a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Request method failure captured: Jun 24 10:10:27.391046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: request: POST /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123/os-volume_attachments HTTP/1.1 Jun 24 10:10:27.391046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept: application/json Jun 24 10:10:27.391046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept-Encoding: identity Jun 24 10:10:27.391046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Connection: close Jun 24 10:10:27.391046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Length: 74 Jun 24 10:10:27.391046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Type: application/json Jun 24 10:10:27.391046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Host: 10.222.0.26 Jun 24 10:10:27.391046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Openstack-System-Scope: None Jun 24 10:10:27.391046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: User-Agent: python-urllib3/1.26.9 Jun 24 10:10:27.391046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Auth-Token: gAAAAABitYyzKx6mxHcouBd786V7PSRKtqG7vQygoeml9ZFRI4t-s7SskaI_N7VnM2cMTHq18lI9OepR13ZTFpIKllTjNCYBqowBTJBvubT2uG08oWBo29qBWawe6q0x1WdImPCEss3dF17N9x8N3_7uAMt0BoG5BjapetFSeerYUrODzwv3CBQ Jun 24 10:10:27.391046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Id: None Jun 24 10:10:27.391046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Name: None Jun 24 10:10:27.391046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Identity-Status: Confirmed Jun 24 10:10:27.391046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Is-Admin-Project: True Jun 24 10:10:27.391046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Id: default Jun 24 10:10:27.391046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Name: Default Jun 24 10:10:27.391046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Id: 64b655c9ef0948c099f60649b9d5e78d Jun 24 10:10:27.391046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Name: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:10:27.391046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Role: reader,member Jun 24 10:10:27.391046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Roles: reader,member Jun 24 10:10:27.392663 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/64b655c9ef0948c099f60649b9d5e78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_64b655c9ef0948c099f60649b9d5e78d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/64b655c9ef0948c099f60649b9d5e78d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/64b655c9ef0948c099f60649b9d5e78d"}]}] Jun 24 10:10:27.392663 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:10:27.392663 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Id: 64b655c9ef0948c099f60649b9d5e78d Jun 24 10:10:27.392663 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:10:27.392663 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User: tempest-AttachVolumeNegativeTest-1676240271-project Jun 24 10:10:27.392663 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Id: default Jun 24 10:10:27.392663 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Name: Default Jun 24 10:10:27.392663 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Id: f2c97e68f66142f9b502b215313f7e80 Jun 24 10:10:27.392663 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Name: tempest-AttachVolumeNegativeTest-1676240271-project Jun 24 10:10:27.392663 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Jun 24 10:10:27.392663 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: {"volumeAttachment": {"volumeId": "c5c48d27-d396-4e90-ba16-d29dbd6bb4e1"}} Jun 24 10:10:27.392663 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: method: > Jun 24 10:10:27.393858 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: exception: Invalid volume: volume c5c48d27-d396-4e90-ba16-d29dbd6bb4e1 is already attached to instances: be64c134-2849-4168-8e6d-ba3cef4f3123 Jun 24 10:10:27.393858 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: action_args: {'server_id': 'be64c134-2849-4168-8e6d-ba3cef4f3123', 'body': {'volumeAttachment': {'volumeId': 'c5c48d27-d396-4e90-ba16-d29dbd6bb4e1'}}} Jun 24 10:10:27.393858 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:10:27.393858 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:10:27.393858 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 10:10:27.393858 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 10:10:27.393858 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 10:10:27.393858 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 10:10:27.393858 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 10:10:27.393858 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 10:10:27.393858 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 24 10:10:27.393858 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 24 10:10:27.393858 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 24 10:10:27.393858 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 24 10:10:27.393858 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c5c48d27-d396-4e90-ba16-d29dbd6bb4e1 is already attached to instances: be64c134-2849-4168-8e6d-ba3cef4f3123 Jun 24 10:10:27.393858 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:10:27.393858 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:10:27.393858 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:10:27.393858 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:10:27.399494 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:10:27.399494 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:10:27.399494 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:10:27.399494 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:10:27.399494 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:10:27.399494 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:10:27.399494 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 10:10:27.399494 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:10:27.399494 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 10:10:27.399494 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:10:27.399494 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 10:10:27.399494 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:10:27.399494 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 24 10:10:27.399494 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 10:10:27.399494 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c5c48d27-d396-4e90-ba16-d29dbd6bb4e1 is already attached to instances: be64c134-2849-4168-8e6d-ba3cef4f3123 Jun 24 10:10:27.399494 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:10:27.399494 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:10:27.399494 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:10:27.399494 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:10:27.399494 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:10:27.402408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:10:27.402408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:10:27.402408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:10:27.402408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c5c48d27-d396-4e90-ba16-d29dbd6bb4e1 is already attached to instances: be64c134-2849-4168-8e6d-ba3cef4f3123 Jun 24 10:10:27.402408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:10:27.402408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-e2fafbd7-d59e-44fe-9ce6-138d12a3982a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Returning 400 to user: Invalid volume: volume c5c48d27-d396-4e90-ba16-d29dbd6bb4e1 is already attached to instances: be64c134-2849-4168-8e6d-ba3cef4f3123 {{(pid=124980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:10:27.402408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-e2fafbd7-d59e-44fe-9ce6-138d12a3982a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "POST /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.142443 Jun 24 10:10:27.402408 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 465/952] 10.222.0.26 () {60 vars in 1322 bytes} [Fri Jun 24 10:10:27 2022] POST /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123/os-volume_attachments => generated 174 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 24 10:10:27.478781 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-b9f6be4f-3ceb-45d6-a9d6-e6696783b875 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:27.479807 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-b9f6be4f-3ceb-45d6-a9d6-e6696783b875 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:27.491038 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b9f6be4f-3ceb-45d6-a9d6-e6696783b875 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:27.499288 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b9f6be4f-3ceb-45d6-a9d6-e6696783b875 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:27.499288 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b9f6be4f-3ceb-45d6-a9d6-e6696783b875 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:27.499288 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b9f6be4f-3ceb-45d6-a9d6-e6696783b875 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:27.599011 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.objects.instance [None req-b9f6be4f-3ceb-45d6-a9d6-e6696783b875 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lazy-loading 'services' on Instance uuid be64c134-2849-4168-8e6d-ba3cef4f3123 {{(pid=124979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:10:27.855679 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-b9f6be4f-3ceb-45d6-a9d6-e6696783b875 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "DELETE /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123/os-volume_attachments/c5c48d27-d396-4e90-ba16-d29dbd6bb4e1" status: 202 len: 0 microversion: 2.1 time: 0.385296 Jun 24 10:10:27.856634 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 488/953] 10.222.0.26 () {58 vars in 1415 bytes} [Fri Jun 24 10:10:27 2022] DELETE /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123/os-volume_attachments/c5c48d27-d396-4e90-ba16-d29dbd6bb4e1 => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:10:27.868756 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-3b564a09-454c-474c-8dc2-756af12441a8 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:27.869859 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-3b564a09-454c-474c-8dc2-756af12441a8 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:27.877971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3b564a09-454c-474c-8dc2-756af12441a8 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:27.878423 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3b564a09-454c-474c-8dc2-756af12441a8 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:27.879237 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3b564a09-454c-474c-8dc2-756af12441a8 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:27.879674 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3b564a09-454c-474c-8dc2-756af12441a8 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:27.926911 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-3b564a09-454c-474c-8dc2-756af12441a8 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063560 Jun 24 10:10:27.927492 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 466/954] 10.222.0.26 () {58 vars in 1301 bytes} [Fri Jun 24 10:10:27 2022] GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:10:28.943910 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-89285bce-f9fe-406c-a990-be4189ef6936 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:28.945137 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-89285bce-f9fe-406c-a990-be4189ef6936 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:28.952026 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-89285bce-f9fe-406c-a990-be4189ef6936 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:28.953003 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-89285bce-f9fe-406c-a990-be4189ef6936 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:28.953781 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-89285bce-f9fe-406c-a990-be4189ef6936 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:28.954215 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-89285bce-f9fe-406c-a990-be4189ef6936 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:28.988592 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-89285bce-f9fe-406c-a990-be4189ef6936 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049563 Jun 24 10:10:28.989169 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 489/955] 10.222.0.26 () {58 vars in 1301 bytes} [Fri Jun 24 10:10:28 2022] GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:10:30.004745 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-8455d145-943f-49ad-9e74-c8c3371ad7cc tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:30.006411 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-8455d145-943f-49ad-9e74-c8c3371ad7cc tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:30.017155 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8455d145-943f-49ad-9e74-c8c3371ad7cc tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:30.017605 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8455d145-943f-49ad-9e74-c8c3371ad7cc tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:30.018383 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8455d145-943f-49ad-9e74-c8c3371ad7cc tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:30.018813 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-8455d145-943f-49ad-9e74-c8c3371ad7cc tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:30.051288 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-8455d145-943f-49ad-9e74-c8c3371ad7cc tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054171 Jun 24 10:10:30.052212 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 467/956] 10.222.0.26 () {58 vars in 1301 bytes} [Fri Jun 24 10:10:29 2022] GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 10:10:30.118293 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-f7a325e1-527d-47fb-931c-fb03a2868cb5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:30.119604 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-f7a325e1-527d-47fb-931c-fb03a2868cb5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:30.127246 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f7a325e1-527d-47fb-931c-fb03a2868cb5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:30.127942 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f7a325e1-527d-47fb-931c-fb03a2868cb5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:30.129279 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f7a325e1-527d-47fb-931c-fb03a2868cb5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:30.130046 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f7a325e1-527d-47fb-931c-fb03a2868cb5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:30.161917 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-f7a325e1-527d-47fb-931c-fb03a2868cb5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] Going to try to terminate instance {{(pid=124979) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:10:30.474808 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-f7a325e1-527d-47fb-931c-fb03a2868cb5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "DELETE /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123" status: 204 len: 0 microversion: 2.1 time: 0.363902 Jun 24 10:10:30.475316 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 490/957] 10.222.0.26 () {58 vars in 1238 bytes} [Fri Jun 24 10:10:30 2022] DELETE /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:10:30.484497 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-4e918254-beac-4847-a650-06d3899236e6 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:30.485111 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-4e918254-beac-4847-a650-06d3899236e6 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:30.492404 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4e918254-beac-4847-a650-06d3899236e6 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:30.492857 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4e918254-beac-4847-a650-06d3899236e6 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:30.493628 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4e918254-beac-4847-a650-06d3899236e6 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:30.494137 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4e918254-beac-4847-a650-06d3899236e6 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:30.647172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-4e918254-beac-4847-a650-06d3899236e6 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:10:30.659782 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-4e918254-beac-4847-a650-06d3899236e6 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123" status: 200 len: 1682 microversion: 2.1 time: 0.179308 Jun 24 10:10:30.660919 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 468/958] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:30 2022] GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123 => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:10:31.682921 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-c90b70ba-5b5a-4af8-89be-547d63e32182 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:31.683766 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-c90b70ba-5b5a-4af8-89be-547d63e32182 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:31.690597 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c90b70ba-5b5a-4af8-89be-547d63e32182 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:31.691048 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c90b70ba-5b5a-4af8-89be-547d63e32182 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:31.691830 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c90b70ba-5b5a-4af8-89be-547d63e32182 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:31.692310 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c90b70ba-5b5a-4af8-89be-547d63e32182 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:31.847141 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-c90b70ba-5b5a-4af8-89be-547d63e32182 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:10:31.860297 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-c90b70ba-5b5a-4af8-89be-547d63e32182 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123" status: 200 len: 1682 microversion: 2.1 time: 0.181390 Jun 24 10:10:31.861295 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 491/959] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:31 2022] GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123 => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:10:32.880786 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-7d0ee407-093d-480f-ace9-fb8073a284fc tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:32.881717 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-7d0ee407-093d-480f-ace9-fb8073a284fc tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:32.891326 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7d0ee407-093d-480f-ace9-fb8073a284fc tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:32.892132 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7d0ee407-093d-480f-ace9-fb8073a284fc tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:32.893532 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7d0ee407-093d-480f-ace9-fb8073a284fc tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:32.894530 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7d0ee407-093d-480f-ace9-fb8073a284fc tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:33.205205 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-7d0ee407-093d-480f-ace9-fb8073a284fc tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:10:33.215172 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-7d0ee407-093d-480f-ace9-fb8073a284fc tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123" status: 200 len: 1682 microversion: 2.1 time: 0.338219 Jun 24 10:10:33.215886 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 469/960] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:32 2022] GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123 => generated 1682 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:10:33.445572 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-13953631-82de-473c-bd25-6023a865fbe0 req-f1ec7e20-4678-4d9f-8124-e888245d9eeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be64c134-2849-4168-8e6d-ba3cef4f3123", "name": "network-vif-deleted", "tag": "ac624c3b-2da8-4c77-aee5-62a4ad7e74b0"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:10:33.471770 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-13953631-82de-473c-bd25-6023a865fbe0 req-f1ec7e20-4678-4d9f-8124-e888245d9eeb service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:33.471770 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-13953631-82de-473c-bd25-6023a865fbe0 req-f1ec7e20-4678-4d9f-8124-e888245d9eeb service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:33.473423 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-13953631-82de-473c-bd25-6023a865fbe0 req-f1ec7e20-4678-4d9f-8124-e888245d9eeb service nova] Creating event network-vif-deleted:ac624c3b-2da8-4c77-aee5-62a4ad7e74b0 for instance be64c134-2849-4168-8e6d-ba3cef4f3123 on hv-cinder-84327 Jun 24 10:10:33.479144 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-13953631-82de-473c-bd25-6023a865fbe0 req-f1ec7e20-4678-4d9f-8124-e888245d9eeb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043614 Jun 24 10:10:33.480191 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 492/961] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:10:34.234076 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-00b6bb61-65b0-42a6-94e6-27af5f0010eb tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:34.235616 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-00b6bb61-65b0-42a6-94e6-27af5f0010eb tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:34.242699 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-00b6bb61-65b0-42a6-94e6-27af5f0010eb tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:34.243353 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-00b6bb61-65b0-42a6-94e6-27af5f0010eb tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:34.244366 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-00b6bb61-65b0-42a6-94e6-27af5f0010eb tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:34.245004 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-00b6bb61-65b0-42a6-94e6-27af5f0010eb tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:34.290937 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-00b6bb61-65b0-42a6-94e6-27af5f0010eb tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:34.291387 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-00b6bb61-65b0-42a6-94e6-27af5f0010eb tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:34.292041 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.objects.instance [None req-00b6bb61-65b0-42a6-94e6-27af5f0010eb tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lazy-loading 'fault' on Instance uuid be64c134-2849-4168-8e6d-ba3cef4f3123 {{(pid=124980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:10:34.341059 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-00b6bb61-65b0-42a6-94e6-27af5f0010eb tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:10:34.349296 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-00b6bb61-65b0-42a6-94e6-27af5f0010eb tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123" status: 200 len: 1331 microversion: 2.1 time: 0.119846 Jun 24 10:10:34.350144 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 470/962] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:34 2022] GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123 => generated 1331 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:10:35.368894 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-f9ae9d11-10b3-4437-89ea-00ab9db3688d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:35.369713 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-f9ae9d11-10b3-4437-89ea-00ab9db3688d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:35.376962 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f9ae9d11-10b3-4437-89ea-00ab9db3688d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:35.377401 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f9ae9d11-10b3-4437-89ea-00ab9db3688d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:35.378168 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f9ae9d11-10b3-4437-89ea-00ab9db3688d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:35.378611 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-f9ae9d11-10b3-4437-89ea-00ab9db3688d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:35.393134 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-f9ae9d11-10b3-4437-89ea-00ab9db3688d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] HTTP exception thrown: Instance be64c134-2849-4168-8e6d-ba3cef4f3123 could not be found. Jun 24 10:10:35.394829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-f9ae9d11-10b3-4437-89ea-00ab9db3688d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Request method failure captured: Jun 24 10:10:35.394829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123 HTTP/1.1 Jun 24 10:10:35.394829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:10:35.394829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:10:35.394829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:10:35.394829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 0 Jun 24 10:10:35.394829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:10:35.394829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:10:35.394829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:10:35.394829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:10:35.394829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitYyzKx6mxHcouBd786V7PSRKtqG7vQygoeml9ZFRI4t-s7SskaI_N7VnM2cMTHq18lI9OepR13ZTFpIKllTjNCYBqowBTJBvubT2uG08oWBo29qBWawe6q0x1WdImPCEss3dF17N9x8N3_7uAMt0BoG5BjapetFSeerYUrODzwv3CBQ Jun 24 10:10:35.394829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:10:35.394829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:10:35.394829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:10:35.394829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:10:35.394829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:10:35.394829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:10:35.394829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: 64b655c9ef0948c099f60649b9d5e78d Jun 24 10:10:35.394829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:10:35.394829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:10:35.394829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:10:35.396773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/64b655c9ef0948c099f60649b9d5e78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_64b655c9ef0948c099f60649b9d5e78d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/64b655c9ef0948c099f60649b9d5e78d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/64b655c9ef0948c099f60649b9d5e78d"}]}] Jun 24 10:10:35.396773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:10:35.396773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: 64b655c9ef0948c099f60649b9d5e78d Jun 24 10:10:35.396773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:10:35.396773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-AttachVolumeNegativeTest-1676240271-project Jun 24 10:10:35.396773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:10:35.396773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:10:35.396773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: f2c97e68f66142f9b502b215313f7e80 Jun 24 10:10:35.396773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-AttachVolumeNegativeTest-1676240271-project Jun 24 10:10:35.396773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: > Jun 24 10:10:35.396773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Instance be64c134-2849-4168-8e6d-ba3cef4f3123 could not be found. Jun 24 10:10:35.396773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'id': 'be64c134-2849-4168-8e6d-ba3cef4f3123'} Jun 24 10:10:35.397677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:10:35.397677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:10:35.397677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:10:35.397677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:10:35.397677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:10:35.397677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:10:35.397677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:10:35.397677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:10:35.397677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:10:35.397677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:10:35.397677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be64c134-2849-4168-8e6d-ba3cef4f3123 could not be found. Jun 24 10:10:35.397677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:10:35.397677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:10:35.397677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:10:35.397677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:10:35.397677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:10:35.397677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:10:35.397677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:10:35.397677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:10:35.397677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:10:35.399656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:10:35.399656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:10:35.399656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:10:35.399656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:10:35.399656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:10:35.399656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:10:35.399656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:10:35.399656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be64c134-2849-4168-8e6d-ba3cef4f3123 could not be found. Jun 24 10:10:35.399656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:10:35.399656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:10:35.399656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:10:35.399656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:10:35.399656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:10:35.399656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:10:35.399656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:10:35.399656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:10:35.399656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be64c134-2849-4168-8e6d-ba3cef4f3123 could not be found. Jun 24 10:10:35.399656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:10:35.401329 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-f9ae9d11-10b3-4437-89ea-00ab9db3688d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Returning 404 to user: Instance be64c134-2849-4168-8e6d-ba3cef4f3123 could not be found. {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:10:35.401329 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-f9ae9d11-10b3-4437-89ea-00ab9db3688d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123" status: 404 len: 111 microversion: 2.1 time: 0.032192 Jun 24 10:10:35.401329 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 493/963] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:35 2022] GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:10:35.406061 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-286d4788-4fb1-4d8a-a649-6979595c5449 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '.version_select at 0x7f03098d84c0>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:35.500047 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-286d4788-4fb1-4d8a-a649-6979595c5449 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1859864998" status: 202 len: 0 microversion: 2.1 time: 0.098018 Jun 24 10:10:35.500669 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 471/964] 10.222.0.26 () {58 vars in 1220 bytes} [Fri Jun 24 10:10:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1859864998 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:10:36.446021 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-5532993d-d384-4e8c-9d5b-d16dbe28b73b tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Action: 'create', calling method: .version_select at 0x7f0309bf0940>, body: {"keypair": {"name": "tempest-keypair-2052135789", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnpMKI70k9JaDXCCphm1uohjTcwWR4fTdU/VImCva37bL2hkUeBHSh4jHsp79nYTAy0QHO7XpCmCkCXWunBGrtUewC/JgU4SrCyz+zfDDY5LRgqbsPhQVHeWM5y2VVSoQ=="}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:10:36.462443 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-5532993d-d384-4e8c-9d5b-d16dbe28b73b tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Getting quotas for project 64b655c9ef0948c099f60649b9d5e78d. Resources: {'key_pairs'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:10:36.466718 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-5532993d-d384-4e8c-9d5b-d16dbe28b73b tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Getting quotas for user f2c97e68f66142f9b502b215313f7e80 and project 64b655c9ef0948c099f60649b9d5e78d. Resources: {'key_pairs'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:10:36.568571 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-5532993d-d384-4e8c-9d5b-d16dbe28b73b tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.126402 Jun 24 10:10:36.569629 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 494/965] 10.222.0.26 () {60 vars in 1158 bytes} [Fri Jun 24 10:10:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:10:39.599659 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-31f339e2-09e2-45f6-866c-6a08c7338c35 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1197458789", "imageRef": "f6b1dddb-2953-41a2-99e3-00aeca441bd9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c1a62ba-de23-4693-a76a-ab88e859eb34"}], "security_groups": [{"name": "tempest-securitygroup--220868018"}], "key_name": "tempest-keypair-2052135789", "user_data": "}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:10:39.718449 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.network.neutron [None req-31f339e2-09e2-45f6-866c-6a08c7338c35 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] validate_networks() for [('2c1a62ba-de23-4693-a76a-ab88e859eb34', None, None, None, None, None)] {{(pid=124980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:10:40.164224 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-31f339e2-09e2-45f6-866c-6a08c7338c35 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Flavor limits 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:10:40.164910 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-31f339e2-09e2-45f6-866c-6a08c7338c35 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Image limits 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:10:40.165685 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-31f339e2-09e2-45f6-866c-6a08c7338c35 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Flavor pref 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:10:40.166361 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-31f339e2-09e2-45f6-866c-6a08c7338c35 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Image pref 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:10:40.167058 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-31f339e2-09e2-45f6-866c-6a08c7338c35 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:10:40.180267 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-31f339e2-09e2-45f6-866c-6a08c7338c35 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:40.180856 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-31f339e2-09e2-45f6-866c-6a08c7338c35 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:40.181714 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-31f339e2-09e2-45f6-866c-6a08c7338c35 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:40.182249 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-31f339e2-09e2-45f6-866c-6a08c7338c35 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:40.201550 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-31f339e2-09e2-45f6-866c-6a08c7338c35 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Getting quotas for project 64b655c9ef0948c099f60649b9d5e78d. Resources: {'instances', 'cores', 'ram'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:10:40.206281 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-31f339e2-09e2-45f6-866c-6a08c7338c35 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Getting quotas for user f2c97e68f66142f9b502b215313f7e80 and project 64b655c9ef0948c099f60649b9d5e78d. Resources: {'instances', 'cores', 'ram'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:10:40.220604 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-31f339e2-09e2-45f6-866c-6a08c7338c35 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Going to run 1 instances... {{(pid=124980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:10:40.224177 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-31f339e2-09e2-45f6-866c-6a08c7338c35 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6b1dddb-2953-41a2-99e3-00aeca441bd9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:10:40.374366 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-31f339e2-09e2-45f6-866c-6a08c7338c35 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.782019 Jun 24 10:10:40.375466 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 472/966] 10.222.0.26 () {60 vars in 1146 bytes} [Fri Jun 24 10:10:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:10:40.387353 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-0ad9e0f0-31cc-45a9-829e-648c88263f3e tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:40.388089 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-0ad9e0f0-31cc-45a9-829e-648c88263f3e tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:40.459501 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-0ad9e0f0-31cc-45a9-829e-648c88263f3e tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:10:40.466859 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-0ad9e0f0-31cc-45a9-829e-648c88263f3e tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf" status: 200 len: 1242 microversion: 2.1 time: 0.083548 Jun 24 10:10:40.467963 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 495/967] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:40 2022] GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:10:41.486677 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-cd6b8ad5-5080-4ccd-8af3-34bf4dce9c90 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:41.488682 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-cd6b8ad5-5080-4ccd-8af3-34bf4dce9c90 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:41.561694 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-cd6b8ad5-5080-4ccd-8af3-34bf4dce9c90 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:10:41.575898 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-cd6b8ad5-5080-4ccd-8af3-34bf4dce9c90 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf" status: 200 len: 1242 microversion: 2.1 time: 0.094383 Jun 24 10:10:41.576527 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 473/968] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:41 2022] GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf => generated 1242 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:10:42.599165 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-271aa8ba-0739-4032-aea6-96abdf7c59e5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:42.600318 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-271aa8ba-0739-4032-aea6-96abdf7c59e5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:42.674506 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-271aa8ba-0739-4032-aea6-96abdf7c59e5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:10:42.682074 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-271aa8ba-0739-4032-aea6-96abdf7c59e5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf" status: 200 len: 1242 microversion: 2.1 time: 0.091098 Jun 24 10:10:42.682650 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 496/969] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:42 2022] GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:10:43.709045 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-0a069975-668a-4a32-887b-7c9f9947297a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:43.710133 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-0a069975-668a-4a32-887b-7c9f9947297a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:43.788241 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-0a069975-668a-4a32-887b-7c9f9947297a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:10:43.796982 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-0a069975-668a-4a32-887b-7c9f9947297a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf" status: 200 len: 1242 microversion: 2.1 time: 0.090248 Jun 24 10:10:43.796982 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 474/970] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:43 2022] GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:10:44.819048 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-1adf9eaf-137b-4bbf-a6f9-a0f2496b3067 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:44.819857 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-1adf9eaf-137b-4bbf-a6f9-a0f2496b3067 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:44.827186 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1adf9eaf-137b-4bbf-a6f9-a0f2496b3067 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:44.827661 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1adf9eaf-137b-4bbf-a6f9-a0f2496b3067 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:44.828455 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1adf9eaf-137b-4bbf-a6f9-a0f2496b3067 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:44.828882 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1adf9eaf-137b-4bbf-a6f9-a0f2496b3067 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:44.907724 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-1adf9eaf-137b-4bbf-a6f9-a0f2496b3067 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:10:44.915725 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-1adf9eaf-137b-4bbf-a6f9-a0f2496b3067 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf" status: 200 len: 1246 microversion: 2.1 time: 0.100801 Jun 24 10:10:44.916344 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 497/971] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:44 2022] GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf => generated 1246 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:10:45.934260 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-837d4668-3a89-45c1-93df-2eab021a2589 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:45.935108 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-837d4668-3a89-45c1-93df-2eab021a2589 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:45.943223 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-837d4668-3a89-45c1-93df-2eab021a2589 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:45.943750 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-837d4668-3a89-45c1-93df-2eab021a2589 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:45.944691 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-837d4668-3a89-45c1-93df-2eab021a2589 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:45.945230 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-837d4668-3a89-45c1-93df-2eab021a2589 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:46.022314 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-837d4668-3a89-45c1-93df-2eab021a2589 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:10:46.031939 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-837d4668-3a89-45c1-93df-2eab021a2589 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf" status: 200 len: 1246 microversion: 2.1 time: 0.101646 Jun 24 10:10:46.032539 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 475/972] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:45 2022] GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf => generated 1246 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:10:47.052114 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-774a17cf-2715-4fb8-9d79-aa722b117417 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:47.053169 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-774a17cf-2715-4fb8-9d79-aa722b117417 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:47.062654 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-774a17cf-2715-4fb8-9d79-aa722b117417 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:47.063215 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-774a17cf-2715-4fb8-9d79-aa722b117417 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:47.064031 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-774a17cf-2715-4fb8-9d79-aa722b117417 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:47.064534 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-774a17cf-2715-4fb8-9d79-aa722b117417 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:47.133672 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-774a17cf-2715-4fb8-9d79-aa722b117417 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:10:47.141991 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-774a17cf-2715-4fb8-9d79-aa722b117417 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf" status: 200 len: 1294 microversion: 2.1 time: 0.096493 Jun 24 10:10:47.142665 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 498/973] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:47 2022] GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf => generated 1294 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:10:47.850599 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-5d8270ae-3d56-4193-95d7-23e23bdf331a tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1567378376", "imageRef": "f6b1dddb-2953-41a2-99e3-00aeca441bd9", "flavorRef": "452"}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:10:47.910593 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.network.neutron [None req-5d8270ae-3d56-4193-95d7-23e23bdf331a tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] validate_networks() for None {{(pid=124980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:10:48.162067 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-01a40295-68f6-4b29-b974-db4f9af3c813 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:48.165245 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-01a40295-68f6-4b29-b974-db4f9af3c813 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:48.167963 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:10:48.173761 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-01a40295-68f6-4b29-b974-db4f9af3c813 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:48.174211 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-01a40295-68f6-4b29-b974-db4f9af3c813 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:48.175039 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-01a40295-68f6-4b29-b974-db4f9af3c813 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:48.175483 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-01a40295-68f6-4b29-b974-db4f9af3c813 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:48.178989 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:10:48.252792 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-01a40295-68f6-4b29-b974-db4f9af3c813 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:10:48.265102 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-01a40295-68f6-4b29-b974-db4f9af3c813 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf" status: 200 len: 1300 microversion: 2.1 time: 0.108608 Jun 24 10:10:48.265724 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 499/974] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:48 2022] GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf => generated 1300 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:10:48.568618 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-5d8270ae-3d56-4193-95d7-23e23bdf331a tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Flavor limits 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:10:48.569176 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-5d8270ae-3d56-4193-95d7-23e23bdf331a tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Image limits 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:10:48.569644 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-5d8270ae-3d56-4193-95d7-23e23bdf331a tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Flavor pref 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:10:48.570051 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-5d8270ae-3d56-4193-95d7-23e23bdf331a tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Image pref 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:10:48.570531 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-5d8270ae-3d56-4193-95d7-23e23bdf331a tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:10:48.579805 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5d8270ae-3d56-4193-95d7-23e23bdf331a tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:48.580278 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5d8270ae-3d56-4193-95d7-23e23bdf331a tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:48.581127 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5d8270ae-3d56-4193-95d7-23e23bdf331a tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:48.581570 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5d8270ae-3d56-4193-95d7-23e23bdf331a tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:48.602159 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-5d8270ae-3d56-4193-95d7-23e23bdf331a tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Getting quotas for project 9efaefae77f74e48addd756c9b8db08f. Resources: {'instances', 'cores', 'ram'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:10:48.611124 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-5d8270ae-3d56-4193-95d7-23e23bdf331a tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Getting quotas for user 6e45f593afe94604b6fe5c20f050d5c2 and project 9efaefae77f74e48addd756c9b8db08f. Resources: {'instances', 'cores', 'ram'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:10:48.631091 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-5d8270ae-3d56-4193-95d7-23e23bdf331a tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Going to run 1 instances... {{(pid=124980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:10:48.634018 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-5d8270ae-3d56-4193-95d7-23e23bdf331a tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] [instance: bcd6217e-73a2-4dae-8323-3d4ff56a80e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6b1dddb-2953-41a2-99e3-00aeca441bd9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:10:48.827245 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-5d8270ae-3d56-4193-95d7-23e23bdf331a tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.982821 Jun 24 10:10:48.838329 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 476/975] 10.222.0.26 () {60 vars in 1146 bytes} [Fri Jun 24 10:10:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:10:48.838689 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-ce0a78c8-578a-4638-8cb7-cb6216bd672f tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:48.839837 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-ce0a78c8-578a-4638-8cb7-cb6216bd672f tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] [instance: bcd6217e-73a2-4dae-8323-3d4ff56a80e3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:48.936449 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-ce0a78c8-578a-4638-8cb7-cb6216bd672f tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e45f593afe94604b6fe5c20f050d5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efaefae77f74e48addd756c9b8db08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:10:48.951128 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-ce0a78c8-578a-4638-8cb7-cb6216bd672f tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] 10.222.0.26 "GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3" status: 200 len: 1215 microversion: 2.1 time: 0.114439 Jun 24 10:10:48.953955 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 500/976] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:48 2022] GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3 => generated 1215 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:10:49.293862 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-494d60cd-36c2-48af-927f-86d9f6b026b2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:49.295071 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-494d60cd-36c2-48af-927f-86d9f6b026b2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:49.306950 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-494d60cd-36c2-48af-927f-86d9f6b026b2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:49.307519 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-494d60cd-36c2-48af-927f-86d9f6b026b2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:49.308457 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-494d60cd-36c2-48af-927f-86d9f6b026b2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:49.309193 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-494d60cd-36c2-48af-927f-86d9f6b026b2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:49.492629 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-494d60cd-36c2-48af-927f-86d9f6b026b2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:10:49.504508 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-494d60cd-36c2-48af-927f-86d9f6b026b2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf" status: 200 len: 1367 microversion: 2.1 time: 0.217659 Jun 24 10:10:49.504998 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 477/977] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:49 2022] GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:10:49.978642 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-aec5fdbf-eb02-42ee-b3c6-71bc233aa3aa tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:49.983862 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-aec5fdbf-eb02-42ee-b3c6-71bc233aa3aa tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] [instance: bcd6217e-73a2-4dae-8323-3d4ff56a80e3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:50.021059 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-01684e26-ee7f-48f2-8df7-18e0a8783883 req-d011a5e9-1b58-4796-a49e-5630b050db97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71237ebb-983e-4e90-98f0-447d662211bf", "tag": "dda683d8-9678-4843-b72c-ec183c3b9416"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:10:50.050689 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-01684e26-ee7f-48f2-8df7-18e0a8783883 req-d011a5e9-1b58-4796-a49e-5630b050db97 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:50.051180 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-01684e26-ee7f-48f2-8df7-18e0a8783883 req-d011a5e9-1b58-4796-a49e-5630b050db97 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:50.088039 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-01684e26-ee7f-48f2-8df7-18e0a8783883 req-d011a5e9-1b58-4796-a49e-5630b050db97 service nova] Creating event network-changed:dda683d8-9678-4843-b72c-ec183c3b9416 for instance 71237ebb-983e-4e90-98f0-447d662211bf on hv-cinder-84327 Jun 24 10:10:50.088521 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-01684e26-ee7f-48f2-8df7-18e0a8783883 req-d011a5e9-1b58-4796-a49e-5630b050db97 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085131 Jun 24 10:10:50.089422 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 478/978] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:10:50.100367 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-aec5fdbf-eb02-42ee-b3c6-71bc233aa3aa tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e45f593afe94604b6fe5c20f050d5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efaefae77f74e48addd756c9b8db08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:10:50.108426 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-aec5fdbf-eb02-42ee-b3c6-71bc233aa3aa tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] 10.222.0.26 "GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3" status: 200 len: 1215 microversion: 2.1 time: 0.136850 Jun 24 10:10:50.109477 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 501/979] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:49 2022] GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3 => generated 1215 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:10:50.527671 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-3b9bb6a1-bf22-4c25-a0bd-43cfec6c5866 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:50.528446 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-3b9bb6a1-bf22-4c25-a0bd-43cfec6c5866 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:50.535783 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3b9bb6a1-bf22-4c25-a0bd-43cfec6c5866 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:50.536260 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3b9bb6a1-bf22-4c25-a0bd-43cfec6c5866 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:50.537047 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3b9bb6a1-bf22-4c25-a0bd-43cfec6c5866 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:50.537485 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3b9bb6a1-bf22-4c25-a0bd-43cfec6c5866 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:50.764903 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-3b9bb6a1-bf22-4c25-a0bd-43cfec6c5866 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:10:50.773364 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-3b9bb6a1-bf22-4c25-a0bd-43cfec6c5866 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf" status: 200 len: 1367 microversion: 2.1 time: 0.249975 Jun 24 10:10:50.773952 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 479/980] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:50 2022] GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:10:51.130859 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-de84ae9b-e18c-469e-802d-cded9ad885d7 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:51.131919 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-de84ae9b-e18c-469e-802d-cded9ad885d7 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] [instance: bcd6217e-73a2-4dae-8323-3d4ff56a80e3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:51.138521 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-de84ae9b-e18c-469e-802d-cded9ad885d7 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:51.139523 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-de84ae9b-e18c-469e-802d-cded9ad885d7 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:51.140332 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-de84ae9b-e18c-469e-802d-cded9ad885d7 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:51.140763 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-de84ae9b-e18c-469e-802d-cded9ad885d7 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:51.206627 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-de84ae9b-e18c-469e-802d-cded9ad885d7 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e45f593afe94604b6fe5c20f050d5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efaefae77f74e48addd756c9b8db08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:10:51.214601 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-de84ae9b-e18c-469e-802d-cded9ad885d7 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] 10.222.0.26 "GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3" status: 200 len: 1211 microversion: 2.1 time: 0.087699 Jun 24 10:10:51.215176 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 502/981] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:51 2022] GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3 => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:10:51.791197 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-3eab1b7f-0e88-4c20-bb98-e13f80d2a48c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:51.792057 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-3eab1b7f-0e88-4c20-bb98-e13f80d2a48c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:51.799687 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3eab1b7f-0e88-4c20-bb98-e13f80d2a48c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:51.800107 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3eab1b7f-0e88-4c20-bb98-e13f80d2a48c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:51.800909 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3eab1b7f-0e88-4c20-bb98-e13f80d2a48c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:51.801351 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3eab1b7f-0e88-4c20-bb98-e13f80d2a48c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:51.948684 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-3eab1b7f-0e88-4c20-bb98-e13f80d2a48c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:10:51.956498 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-3eab1b7f-0e88-4c20-bb98-e13f80d2a48c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf" status: 200 len: 1367 microversion: 2.1 time: 0.169378 Jun 24 10:10:51.957060 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 480/982] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:51 2022] GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:10:52.233211 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-dcdacc1b-ca54-4c04-9a42-e57d2ef9cfdf tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:52.234023 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-dcdacc1b-ca54-4c04-9a42-e57d2ef9cfdf tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] [instance: bcd6217e-73a2-4dae-8323-3d4ff56a80e3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:52.240571 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-dcdacc1b-ca54-4c04-9a42-e57d2ef9cfdf tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:52.241022 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-dcdacc1b-ca54-4c04-9a42-e57d2ef9cfdf tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:52.242228 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-dcdacc1b-ca54-4c04-9a42-e57d2ef9cfdf tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:52.242988 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-dcdacc1b-ca54-4c04-9a42-e57d2ef9cfdf tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:52.317522 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-dcdacc1b-ca54-4c04-9a42-e57d2ef9cfdf tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e45f593afe94604b6fe5c20f050d5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efaefae77f74e48addd756c9b8db08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:10:52.325739 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-dcdacc1b-ca54-4c04-9a42-e57d2ef9cfdf tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] 10.222.0.26 "GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3" status: 200 len: 1267 microversion: 2.1 time: 0.097181 Jun 24 10:10:52.326867 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 503/983] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:52 2022] GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3 => generated 1267 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:10:52.974236 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-7688183a-9155-4fa4-8cff-8f25a95593e0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:52.974961 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-7688183a-9155-4fa4-8cff-8f25a95593e0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:52.982719 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7688183a-9155-4fa4-8cff-8f25a95593e0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:52.985271 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7688183a-9155-4fa4-8cff-8f25a95593e0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:52.985271 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7688183a-9155-4fa4-8cff-8f25a95593e0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:52.985271 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7688183a-9155-4fa4-8cff-8f25a95593e0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:53.350508 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-a777c478-3963-4931-b7c1-cd315a0345e4 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:53.351043 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-7688183a-9155-4fa4-8cff-8f25a95593e0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:10:53.352551 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-a777c478-3963-4931-b7c1-cd315a0345e4 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] [instance: bcd6217e-73a2-4dae-8323-3d4ff56a80e3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:53.365399 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-7688183a-9155-4fa4-8cff-8f25a95593e0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf" status: 200 len: 1367 microversion: 2.1 time: 0.394607 Jun 24 10:10:53.366780 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 481/984] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:52 2022] GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf => generated 1367 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:10:53.367207 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a777c478-3963-4931-b7c1-cd315a0345e4 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:53.368527 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a777c478-3963-4931-b7c1-cd315a0345e4 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:53.369930 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a777c478-3963-4931-b7c1-cd315a0345e4 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:53.371375 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a777c478-3963-4931-b7c1-cd315a0345e4 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:53.455546 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-a777c478-3963-4931-b7c1-cd315a0345e4 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e45f593afe94604b6fe5c20f050d5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efaefae77f74e48addd756c9b8db08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:10:53.463478 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-a777c478-3963-4931-b7c1-cd315a0345e4 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] 10.222.0.26 "GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3" status: 200 len: 1273 microversion: 2.1 time: 0.119763 Jun 24 10:10:53.464910 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 504/985] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:53 2022] GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3 => generated 1273 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:10:54.389457 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-11428f67-1152-4c3e-9281-1b3b90e73e77 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:54.390960 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-11428f67-1152-4c3e-9281-1b3b90e73e77 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:54.399329 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-11428f67-1152-4c3e-9281-1b3b90e73e77 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:54.406282 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-11428f67-1152-4c3e-9281-1b3b90e73e77 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:54.406282 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-11428f67-1152-4c3e-9281-1b3b90e73e77 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:54.406282 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-11428f67-1152-4c3e-9281-1b3b90e73e77 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:54.482157 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-2b20af32-be7a-4708-9935-83c97ba5c7e6 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:54.483945 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-2b20af32-be7a-4708-9935-83c97ba5c7e6 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] [instance: bcd6217e-73a2-4dae-8323-3d4ff56a80e3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:54.491391 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2b20af32-be7a-4708-9935-83c97ba5c7e6 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:54.491931 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2b20af32-be7a-4708-9935-83c97ba5c7e6 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:54.492891 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2b20af32-be7a-4708-9935-83c97ba5c7e6 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:54.493396 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2b20af32-be7a-4708-9935-83c97ba5c7e6 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:54.652775 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-2b20af32-be7a-4708-9935-83c97ba5c7e6 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e45f593afe94604b6fe5c20f050d5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efaefae77f74e48addd756c9b8db08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:10:54.660995 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-2b20af32-be7a-4708-9935-83c97ba5c7e6 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] 10.222.0.26 "GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3" status: 200 len: 1315 microversion: 2.1 time: 0.182884 Jun 24 10:10:54.661745 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 505/986] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:54 2022] GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:10:54.674132 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-11428f67-1152-4c3e-9281-1b3b90e73e77 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:10:54.682704 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-11428f67-1152-4c3e-9281-1b3b90e73e77 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf" status: 200 len: 1367 microversion: 2.1 time: 0.303082 Jun 24 10:10:54.683389 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 482/987] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:54 2022] GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf => generated 1367 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:10:54.951499 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-181bfdb4-ac34-43bb-a788-78cd69c3e601 req-b87386f1-e658-4920-877d-348d79f48708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71237ebb-983e-4e90-98f0-447d662211bf", "name": "network-vif-plugged", "status": "completed", "tag": "dda683d8-9678-4843-b72c-ec183c3b9416"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:10:54.964379 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-181bfdb4-ac34-43bb-a788-78cd69c3e601 req-b87386f1-e658-4920-877d-348d79f48708 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:54.965399 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-181bfdb4-ac34-43bb-a788-78cd69c3e601 req-b87386f1-e658-4920-877d-348d79f48708 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:54.986870 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-181bfdb4-ac34-43bb-a788-78cd69c3e601 req-b87386f1-e658-4920-877d-348d79f48708 service nova] Creating event network-vif-plugged:dda683d8-9678-4843-b72c-ec183c3b9416 for instance 71237ebb-983e-4e90-98f0-447d662211bf on hv-cinder-84327 Jun 24 10:10:54.998868 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-181bfdb4-ac34-43bb-a788-78cd69c3e601 req-b87386f1-e658-4920-877d-348d79f48708 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054749 Jun 24 10:10:55.000251 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 506/988] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:10:55.462747 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-e1a07a19-6a7a-483d-bd22-716d45d5050c req-cdb34bfc-26be-420b-9c9e-c6e9c786d791 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcd6217e-73a2-4dae-8323-3d4ff56a80e3", "tag": "daac7df9-2c0e-4a78-b445-1ab0237d8f47"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:10:55.480613 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-e1a07a19-6a7a-483d-bd22-716d45d5050c req-cdb34bfc-26be-420b-9c9e-c6e9c786d791 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:55.481181 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-e1a07a19-6a7a-483d-bd22-716d45d5050c req-cdb34bfc-26be-420b-9c9e-c6e9c786d791 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:55.493756 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-e1a07a19-6a7a-483d-bd22-716d45d5050c req-cdb34bfc-26be-420b-9c9e-c6e9c786d791 service nova] Creating event network-changed:daac7df9-2c0e-4a78-b445-1ab0237d8f47 for instance bcd6217e-73a2-4dae-8323-3d4ff56a80e3 on hv-cinder-84327 Jun 24 10:10:55.499978 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-e1a07a19-6a7a-483d-bd22-716d45d5050c req-cdb34bfc-26be-420b-9c9e-c6e9c786d791 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043238 Jun 24 10:10:55.500804 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 483/989] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:10:55.684104 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-af242ce8-2e4f-4168-acdf-f96274b38635 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:55.685312 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-af242ce8-2e4f-4168-acdf-f96274b38635 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] [instance: bcd6217e-73a2-4dae-8323-3d4ff56a80e3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:55.695062 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-af242ce8-2e4f-4168-acdf-f96274b38635 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:55.695848 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-af242ce8-2e4f-4168-acdf-f96274b38635 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:55.696952 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-af242ce8-2e4f-4168-acdf-f96274b38635 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:55.697303 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-af242ce8-2e4f-4168-acdf-f96274b38635 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:55.702685 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-30f5bbcc-9fda-427f-b997-7ce5d3a8e5a3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:55.707029 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-30f5bbcc-9fda-427f-b997-7ce5d3a8e5a3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:55.710623 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-30f5bbcc-9fda-427f-b997-7ce5d3a8e5a3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:55.711333 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-30f5bbcc-9fda-427f-b997-7ce5d3a8e5a3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:55.712342 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-30f5bbcc-9fda-427f-b997-7ce5d3a8e5a3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:55.712956 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-30f5bbcc-9fda-427f-b997-7ce5d3a8e5a3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:55.865291 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-af242ce8-2e4f-4168-acdf-f96274b38635 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e45f593afe94604b6fe5c20f050d5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efaefae77f74e48addd756c9b8db08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:10:55.875228 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-af242ce8-2e4f-4168-acdf-f96274b38635 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] 10.222.0.26 "GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3" status: 200 len: 1315 microversion: 2.1 time: 0.198599 Jun 24 10:10:55.876398 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 507/990] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:55 2022] GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:10:55.939464 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-30f5bbcc-9fda-427f-b997-7ce5d3a8e5a3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:10:55.951088 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-30f5bbcc-9fda-427f-b997-7ce5d3a8e5a3 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf" status: 200 len: 1367 microversion: 2.1 time: 0.253762 Jun 24 10:10:55.952141 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 484/991] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:55 2022] GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:10:56.895241 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-b64c29e9-b989-40ec-9b4a-f8ba8e3de5d8 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:56.895997 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-b64c29e9-b989-40ec-9b4a-f8ba8e3de5d8 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] [instance: bcd6217e-73a2-4dae-8323-3d4ff56a80e3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:56.902951 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b64c29e9-b989-40ec-9b4a-f8ba8e3de5d8 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:56.903411 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b64c29e9-b989-40ec-9b4a-f8ba8e3de5d8 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:56.905188 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b64c29e9-b989-40ec-9b4a-f8ba8e3de5d8 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:56.905821 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b64c29e9-b989-40ec-9b4a-f8ba8e3de5d8 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:56.976014 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-2da09fa5-57d4-40f2-afa2-30811d2f73d6 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:56.976702 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-2da09fa5-57d4-40f2-afa2-30811d2f73d6 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:56.983475 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2da09fa5-57d4-40f2-afa2-30811d2f73d6 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:56.983926 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2da09fa5-57d4-40f2-afa2-30811d2f73d6 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:56.984755 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2da09fa5-57d4-40f2-afa2-30811d2f73d6 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:56.985194 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2da09fa5-57d4-40f2-afa2-30811d2f73d6 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:57.050280 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-b64c29e9-b989-40ec-9b4a-f8ba8e3de5d8 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e45f593afe94604b6fe5c20f050d5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efaefae77f74e48addd756c9b8db08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:10:57.059933 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-b64c29e9-b989-40ec-9b4a-f8ba8e3de5d8 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] 10.222.0.26 "GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3" status: 200 len: 1315 microversion: 2.1 time: 0.169929 Jun 24 10:10:57.061142 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 508/992] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:56 2022] GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:10:57.141281 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2da09fa5-57d4-40f2-afa2-30811d2f73d6 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:10:57.148460 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-2da09fa5-57d4-40f2-afa2-30811d2f73d6 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf" status: 200 len: 1367 microversion: 2.1 time: 0.176508 Jun 24 10:10:57.148948 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 485/993] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:56 2022] GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:10:58.079164 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-5037e29d-42be-4eaf-830b-7cd39b227e25 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:58.079824 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-5037e29d-42be-4eaf-830b-7cd39b227e25 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] [instance: bcd6217e-73a2-4dae-8323-3d4ff56a80e3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:58.086983 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5037e29d-42be-4eaf-830b-7cd39b227e25 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:58.087442 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5037e29d-42be-4eaf-830b-7cd39b227e25 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:58.088977 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5037e29d-42be-4eaf-830b-7cd39b227e25 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:58.088977 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5037e29d-42be-4eaf-830b-7cd39b227e25 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:58.169561 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-98440db2-6cca-40c9-8913-f74ebf6abb1b tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:58.173438 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-98440db2-6cca-40c9-8913-f74ebf6abb1b tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:58.174205 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:10:58.182800 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-98440db2-6cca-40c9-8913-f74ebf6abb1b tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:58.185865 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-98440db2-6cca-40c9-8913-f74ebf6abb1b tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:58.185865 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-98440db2-6cca-40c9-8913-f74ebf6abb1b tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:58.185865 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-98440db2-6cca-40c9-8913-f74ebf6abb1b tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:58.191014 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=99 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:10:58.422506 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-5037e29d-42be-4eaf-830b-7cd39b227e25 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e45f593afe94604b6fe5c20f050d5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efaefae77f74e48addd756c9b8db08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:10:58.432941 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-5037e29d-42be-4eaf-830b-7cd39b227e25 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] 10.222.0.26 "GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3" status: 200 len: 1315 microversion: 2.1 time: 0.358200 Jun 24 10:10:58.435902 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 509/994] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:58 2022] GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3 => generated 1315 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:10:58.516486 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-98440db2-6cca-40c9-8913-f74ebf6abb1b tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:10:58.524986 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-98440db2-6cca-40c9-8913-f74ebf6abb1b tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf" status: 200 len: 1557 microversion: 2.1 time: 0.362077 Jun 24 10:10:58.525567 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 486/995] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:58 2022] GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf => generated 1557 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:10:58.542383 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-fb4b3851-b81a-43d0-bf83-1942cb17a32d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:58.543262 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-fb4b3851-b81a-43d0-bf83-1942cb17a32d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:58.550227 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fb4b3851-b81a-43d0-bf83-1942cb17a32d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:58.550682 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fb4b3851-b81a-43d0-bf83-1942cb17a32d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:58.551487 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fb4b3851-b81a-43d0-bf83-1942cb17a32d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:58.552218 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fb4b3851-b81a-43d0-bf83-1942cb17a32d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:58.644906 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-fb4b3851-b81a-43d0-bf83-1942cb17a32d tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105768 Jun 24 10:10:58.646507 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 510/996] 10.222.0.26 () {58 vars in 1274 bytes} [Fri Jun 24 10:10:58 2022] GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:10:59.452627 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-7cced467-fb2e-463b-a9fa-17fe6925b8ec tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:59.453647 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-7cced467-fb2e-463b-a9fa-17fe6925b8ec tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] [instance: bcd6217e-73a2-4dae-8323-3d4ff56a80e3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:10:59.457011 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell0:SELECT=4 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:10:59.457702 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell0:SELECT=16 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:10:59.463878 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7cced467-fb2e-463b-a9fa-17fe6925b8ec tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:59.471510 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7cced467-fb2e-463b-a9fa-17fe6925b8ec tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:59.471510 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7cced467-fb2e-463b-a9fa-17fe6925b8ec tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:10:59.471510 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7cced467-fb2e-463b-a9fa-17fe6925b8ec tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:10:59.758327 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-7cced467-fb2e-463b-a9fa-17fe6925b8ec tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e45f593afe94604b6fe5c20f050d5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efaefae77f74e48addd756c9b8db08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:10:59.767368 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-7cced467-fb2e-463b-a9fa-17fe6925b8ec tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] 10.222.0.26 "GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3" status: 200 len: 1315 microversion: 2.1 time: 0.319936 Jun 24 10:10:59.768392 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 487/997] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:10:59 2022] GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:11:00.087703 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-d1e3bf3e-2e76-4327-bcc3-6e211c383509 req-b3ede102-c8f3-45d6-9f74-eec8c4632d09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71237ebb-983e-4e90-98f0-447d662211bf", "tag": "dda683d8-9678-4843-b72c-ec183c3b9416"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:11:00.099470 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-d1e3bf3e-2e76-4327-bcc3-6e211c383509 req-b3ede102-c8f3-45d6-9f74-eec8c4632d09 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:00.100078 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-d1e3bf3e-2e76-4327-bcc3-6e211c383509 req-b3ede102-c8f3-45d6-9f74-eec8c4632d09 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:00.110553 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell0:SELECT=12 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:11:00.113057 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-d1e3bf3e-2e76-4327-bcc3-6e211c383509 req-b3ede102-c8f3-45d6-9f74-eec8c4632d09 service nova] Creating event network-changed:dda683d8-9678-4843-b72c-ec183c3b9416 for instance 71237ebb-983e-4e90-98f0-447d662211bf on hv-cinder-84327 Jun 24 10:11:00.118528 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-d1e3bf3e-2e76-4327-bcc3-6e211c383509 req-b3ede102-c8f3-45d6-9f74-eec8c4632d09 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035078 Jun 24 10:11:00.119273 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 511/998] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:11:00.786641 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-7b7812d9-3815-4abe-9672-c27765eddbcb tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:11:00.787236 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-7b7812d9-3815-4abe-9672-c27765eddbcb tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] [instance: bcd6217e-73a2-4dae-8323-3d4ff56a80e3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:11:00.794124 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7b7812d9-3815-4abe-9672-c27765eddbcb tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:00.795388 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7b7812d9-3815-4abe-9672-c27765eddbcb tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:00.796217 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7b7812d9-3815-4abe-9672-c27765eddbcb tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:00.796715 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7b7812d9-3815-4abe-9672-c27765eddbcb tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:00.959560 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-7b7812d9-3815-4abe-9672-c27765eddbcb tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e45f593afe94604b6fe5c20f050d5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efaefae77f74e48addd756c9b8db08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:11:00.961858 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-7b7812d9-3815-4abe-9672-c27765eddbcb tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] 10.222.0.26 "GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3" status: 200 len: 1315 microversion: 2.1 time: 0.179760 Jun 24 10:11:00.962438 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 488/999] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:11:00 2022] GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:11:01.981170 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-ab37ef86-fc61-4542-aea3-aa8768733db3 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:11:01.981902 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-ab37ef86-fc61-4542-aea3-aa8768733db3 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] [instance: bcd6217e-73a2-4dae-8323-3d4ff56a80e3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:11:01.989112 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ab37ef86-fc61-4542-aea3-aa8768733db3 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:01.989551 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ab37ef86-fc61-4542-aea3-aa8768733db3 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:01.990314 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ab37ef86-fc61-4542-aea3-aa8768733db3 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:01.990750 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ab37ef86-fc61-4542-aea3-aa8768733db3 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:02.135974 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-ab37ef86-fc61-4542-aea3-aa8768733db3 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e45f593afe94604b6fe5c20f050d5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efaefae77f74e48addd756c9b8db08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:11:02.143340 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-ab37ef86-fc61-4542-aea3-aa8768733db3 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] 10.222.0.26 "GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3" status: 200 len: 1315 microversion: 2.1 time: 0.167439 Jun 24 10:11:02.143897 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 512/1000] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:11:01 2022] GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:11:02.897197 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-23a31d08-bf88-444a-8467-f580b0063583 req-8aa399fe-6985-4aa6-b1fe-237763b68a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd6217e-73a2-4dae-8323-3d4ff56a80e3", "name": "network-vif-plugged", "status": "completed", "tag": "daac7df9-2c0e-4a78-b445-1ab0237d8f47"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:11:02.909130 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-23a31d08-bf88-444a-8467-f580b0063583 req-8aa399fe-6985-4aa6-b1fe-237763b68a5a service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:02.909703 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-23a31d08-bf88-444a-8467-f580b0063583 req-8aa399fe-6985-4aa6-b1fe-237763b68a5a service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:02.922136 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-23a31d08-bf88-444a-8467-f580b0063583 req-8aa399fe-6985-4aa6-b1fe-237763b68a5a service nova] Creating event network-vif-plugged:daac7df9-2c0e-4a78-b445-1ab0237d8f47 for instance bcd6217e-73a2-4dae-8323-3d4ff56a80e3 on hv-cinder-84327 Jun 24 10:11:02.927566 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-23a31d08-bf88-444a-8467-f580b0063583 req-8aa399fe-6985-4aa6-b1fe-237763b68a5a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034338 Jun 24 10:11:02.928382 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 489/1001] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:11:03.161119 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-cd71196b-06a4-4593-8528-5c548b4525b3 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:11:03.161658 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-cd71196b-06a4-4593-8528-5c548b4525b3 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] [instance: bcd6217e-73a2-4dae-8323-3d4ff56a80e3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:11:03.168588 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-cd71196b-06a4-4593-8528-5c548b4525b3 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:03.169172 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-cd71196b-06a4-4593-8528-5c548b4525b3 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:03.169969 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-cd71196b-06a4-4593-8528-5c548b4525b3 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:03.170432 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-cd71196b-06a4-4593-8528-5c548b4525b3 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:03.317108 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-cd71196b-06a4-4593-8528-5c548b4525b3 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e45f593afe94604b6fe5c20f050d5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efaefae77f74e48addd756c9b8db08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:11:03.326758 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-cd71196b-06a4-4593-8528-5c548b4525b3 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] 10.222.0.26 "GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3" status: 200 len: 1315 microversion: 2.1 time: 0.169075 Jun 24 10:11:03.327523 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 513/1002] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:11:03 2022] GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:11:04.345908 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-b65c3186-748d-4677-b22a-8850dfc83af1 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:11:04.346650 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-b65c3186-748d-4677-b22a-8850dfc83af1 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] [instance: bcd6217e-73a2-4dae-8323-3d4ff56a80e3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:11:04.358431 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b65c3186-748d-4677-b22a-8850dfc83af1 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:04.358885 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b65c3186-748d-4677-b22a-8850dfc83af1 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:04.359670 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b65c3186-748d-4677-b22a-8850dfc83af1 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:04.360111 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b65c3186-748d-4677-b22a-8850dfc83af1 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:04.516169 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-b65c3186-748d-4677-b22a-8850dfc83af1 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e45f593afe94604b6fe5c20f050d5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efaefae77f74e48addd756c9b8db08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:11:04.524234 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-b65c3186-748d-4677-b22a-8850dfc83af1 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] 10.222.0.26 "GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3" status: 200 len: 1315 microversion: 2.1 time: 0.184261 Jun 24 10:11:04.524838 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 490/1003] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:11:04 2022] GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:11:05.542154 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-0c06c591-0d4c-45f0-9d60-500f101d515c tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:11:05.542766 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-0c06c591-0d4c-45f0-9d60-500f101d515c tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] [instance: bcd6217e-73a2-4dae-8323-3d4ff56a80e3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:11:05.549351 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0c06c591-0d4c-45f0-9d60-500f101d515c tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:05.549801 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0c06c591-0d4c-45f0-9d60-500f101d515c tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:05.550560 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0c06c591-0d4c-45f0-9d60-500f101d515c tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:05.550988 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0c06c591-0d4c-45f0-9d60-500f101d515c tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:05.721551 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-0c06c591-0d4c-45f0-9d60-500f101d515c tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e45f593afe94604b6fe5c20f050d5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efaefae77f74e48addd756c9b8db08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:11:05.729968 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-0c06c591-0d4c-45f0-9d60-500f101d515c tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] 10.222.0.26 "GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3" status: 200 len: 1465 microversion: 2.1 time: 0.191828 Jun 24 10:11:05.730527 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 514/1004] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:11:05 2022] GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3 => generated 1465 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:11:05.774412 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-75a799b1-7765-4411-91e3-a014243f063d tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:11:05.774974 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-75a799b1-7765-4411-91e3-a014243f063d tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] [instance: bcd6217e-73a2-4dae-8323-3d4ff56a80e3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:11:05.782496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-75a799b1-7765-4411-91e3-a014243f063d tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:05.782934 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-75a799b1-7765-4411-91e3-a014243f063d tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:05.783724 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-75a799b1-7765-4411-91e3-a014243f063d tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:05.784229 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-75a799b1-7765-4411-91e3-a014243f063d tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:05.812771 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-75a799b1-7765-4411-91e3-a014243f063d tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] [instance: bcd6217e-73a2-4dae-8323-3d4ff56a80e3] Going to try to terminate instance {{(pid=124980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:11:06.268416 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-75a799b1-7765-4411-91e3-a014243f063d tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3" status: 204 len: 0 microversion: 2.1 time: 0.498112 Jun 24 10:11:06.269013 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 491/1005] 10.222.0.26 () {58 vars in 1238 bytes} [Fri Jun 24 10:11:05 2022] DELETE /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:11:06.277752 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-25da119c-77f7-454f-8503-be74e9f5f51e tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:11:06.278367 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-25da119c-77f7-454f-8503-be74e9f5f51e tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] [instance: bcd6217e-73a2-4dae-8323-3d4ff56a80e3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:11:06.285279 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-25da119c-77f7-454f-8503-be74e9f5f51e tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:06.285733 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-25da119c-77f7-454f-8503-be74e9f5f51e tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:06.286506 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-25da119c-77f7-454f-8503-be74e9f5f51e tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:06.286974 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-25da119c-77f7-454f-8503-be74e9f5f51e tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:06.461419 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-25da119c-77f7-454f-8503-be74e9f5f51e tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e45f593afe94604b6fe5c20f050d5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efaefae77f74e48addd756c9b8db08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:11:06.473769 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-25da119c-77f7-454f-8503-be74e9f5f51e tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] 10.222.0.26 "GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3" status: 200 len: 1471 microversion: 2.1 time: 0.199706 Jun 24 10:11:06.474572 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 515/1006] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:11:06 2022] GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3 => generated 1471 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:11:07.497127 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-7a9e6198-c2ae-4e29-bc8b-053255ffc3eb tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:11:07.498076 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-7a9e6198-c2ae-4e29-bc8b-053255ffc3eb tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] [instance: bcd6217e-73a2-4dae-8323-3d4ff56a80e3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:11:07.505432 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7a9e6198-c2ae-4e29-bc8b-053255ffc3eb tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:07.505944 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7a9e6198-c2ae-4e29-bc8b-053255ffc3eb tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:07.506733 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7a9e6198-c2ae-4e29-bc8b-053255ffc3eb tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:07.507209 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7a9e6198-c2ae-4e29-bc8b-053255ffc3eb tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:07.663113 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-7a9e6198-c2ae-4e29-bc8b-053255ffc3eb tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e45f593afe94604b6fe5c20f050d5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efaefae77f74e48addd756c9b8db08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:11:07.676628 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-7a9e6198-c2ae-4e29-bc8b-053255ffc3eb tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] 10.222.0.26 "GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3" status: 200 len: 1471 microversion: 2.1 time: 0.183600 Jun 24 10:11:07.677935 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 492/1007] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:11:07 2022] GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3 => generated 1471 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:11:08.412734 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-ef65b346-581c-4cc7-a790-abf58a4650b2 req-a8ad60af-f355-4b03-8412-5c58f07b5746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcd6217e-73a2-4dae-8323-3d4ff56a80e3", "name": "network-vif-deleted", "tag": "daac7df9-2c0e-4a78-b445-1ab0237d8f47"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:11:08.432387 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-ef65b346-581c-4cc7-a790-abf58a4650b2 req-a8ad60af-f355-4b03-8412-5c58f07b5746 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:08.432846 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-ef65b346-581c-4cc7-a790-abf58a4650b2 req-a8ad60af-f355-4b03-8412-5c58f07b5746 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:08.448739 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-ef65b346-581c-4cc7-a790-abf58a4650b2 req-a8ad60af-f355-4b03-8412-5c58f07b5746 service nova] Creating event network-vif-deleted:daac7df9-2c0e-4a78-b445-1ab0237d8f47 for instance bcd6217e-73a2-4dae-8323-3d4ff56a80e3 on hv-cinder-84327 Jun 24 10:11:08.455693 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-ef65b346-581c-4cc7-a790-abf58a4650b2 req-a8ad60af-f355-4b03-8412-5c58f07b5746 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047322 Jun 24 10:11:08.458052 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 516/1008] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:11:08.694129 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-d5736996-a569-49d1-89eb-9d32bdb0994f tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:11:08.694873 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-d5736996-a569-49d1-89eb-9d32bdb0994f tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] [instance: bcd6217e-73a2-4dae-8323-3d4ff56a80e3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:11:08.701687 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d5736996-a569-49d1-89eb-9d32bdb0994f tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:08.704989 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d5736996-a569-49d1-89eb-9d32bdb0994f tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:08.704989 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d5736996-a569-49d1-89eb-9d32bdb0994f tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:08.704989 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d5736996-a569-49d1-89eb-9d32bdb0994f tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:08.783573 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d5736996-a569-49d1-89eb-9d32bdb0994f tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e45f593afe94604b6fe5c20f050d5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efaefae77f74e48addd756c9b8db08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:11:08.791706 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-d5736996-a569-49d1-89eb-9d32bdb0994f tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] 10.222.0.26 "GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3" status: 200 len: 1300 microversion: 2.1 time: 0.101447 Jun 24 10:11:08.792536 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 493/1009] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:11:08 2022] GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3 => generated 1300 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:11:09.810158 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-2b4ca706-94f4-4f3d-888b-47deeb07a84d tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:11:09.810864 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-2b4ca706-94f4-4f3d-888b-47deeb07a84d tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] [instance: bcd6217e-73a2-4dae-8323-3d4ff56a80e3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:11:09.817913 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2b4ca706-94f4-4f3d-888b-47deeb07a84d tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:09.818359 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2b4ca706-94f4-4f3d-888b-47deeb07a84d tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:09.819134 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2b4ca706-94f4-4f3d-888b-47deeb07a84d tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:09.819571 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2b4ca706-94f4-4f3d-888b-47deeb07a84d tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:09.857891 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2b4ca706-94f4-4f3d-888b-47deeb07a84d tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:09.858340 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2b4ca706-94f4-4f3d-888b-47deeb07a84d tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:09.858811 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.objects.instance [None req-2b4ca706-94f4-4f3d-888b-47deeb07a84d tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lazy-loading 'fault' on Instance uuid bcd6217e-73a2-4dae-8323-3d4ff56a80e3 {{(pid=124979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:11:09.901394 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-2b4ca706-94f4-4f3d-888b-47deeb07a84d tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e45f593afe94604b6fe5c20f050d5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9efaefae77f74e48addd756c9b8db08f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:11:09.909016 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-2b4ca706-94f4-4f3d-888b-47deeb07a84d tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] 10.222.0.26 "GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3" status: 200 len: 1305 microversion: 2.1 time: 0.103170 Jun 24 10:11:09.909599 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 517/1010] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:11:09 2022] GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3 => generated 1305 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:11:10.927280 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-c59d12b8-783c-4dcb-9f75-bcd71ae136d9 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:11:10.927922 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-c59d12b8-783c-4dcb-9f75-bcd71ae136d9 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] [instance: bcd6217e-73a2-4dae-8323-3d4ff56a80e3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:11:10.934875 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c59d12b8-783c-4dcb-9f75-bcd71ae136d9 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:10.935321 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c59d12b8-783c-4dcb-9f75-bcd71ae136d9 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:10.936167 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c59d12b8-783c-4dcb-9f75-bcd71ae136d9 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:10.936619 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c59d12b8-783c-4dcb-9f75-bcd71ae136d9 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:10.950468 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.wsgi [None req-c59d12b8-783c-4dcb-9f75-bcd71ae136d9 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] HTTP exception thrown: Instance bcd6217e-73a2-4dae-8323-3d4ff56a80e3 could not be found. Jun 24 10:11:10.952683 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-c59d12b8-783c-4dcb-9f75-bcd71ae136d9 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Request method failure captured: Jun 24 10:11:10.952683 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: request: GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3 HTTP/1.1 Jun 24 10:11:10.952683 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept: application/json Jun 24 10:11:10.952683 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept-Encoding: identity Jun 24 10:11:10.952683 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Connection: close Jun 24 10:11:10.952683 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Length: 0 Jun 24 10:11:10.952683 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Type: application/json Jun 24 10:11:10.952683 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Host: 10.222.0.26 Jun 24 10:11:10.952683 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Openstack-System-Scope: None Jun 24 10:11:10.952683 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: User-Agent: python-urllib3/1.26.9 Jun 24 10:11:10.952683 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Auth-Token: gAAAAABitY2l0cmjo7llKXVAkj6NPk7f7EWJYJVPR-XOvMAgJ-aPavaEBDt-cNXN0tvVBgWHDF5QdJkZ__EB_rNa-keohQK22dDWNYtmJwPi1gmoJG2ZiCDmYavpMuQwHJOLZgK8o2k24EN1xA9ywzdFIJmiIs7A_E4F7BqkrotDjAhDE2vPX0A Jun 24 10:11:10.952683 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Id: None Jun 24 10:11:10.952683 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Name: None Jun 24 10:11:10.952683 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Identity-Status: Confirmed Jun 24 10:11:10.952683 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Is-Admin-Project: True Jun 24 10:11:10.952683 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Id: default Jun 24 10:11:10.952683 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Name: Default Jun 24 10:11:10.952683 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Id: 9efaefae77f74e48addd756c9b8db08f Jun 24 10:11:10.952683 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Name: tempest-VolumesNegativeTest-943916042 Jun 24 10:11:10.952683 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Role: reader,member Jun 24 10:11:10.952683 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Roles: reader,member Jun 24 10:11:10.954727 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9efaefae77f74e48addd756c9b8db08f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9efaefae77f74e48addd756c9b8db08f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9efaefae77f74e48addd756c9b8db08f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9efaefae77f74e48addd756c9b8db08f"}]}] Jun 24 10:11:10.954727 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant: tempest-VolumesNegativeTest-943916042 Jun 24 10:11:10.954727 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Id: 9efaefae77f74e48addd756c9b8db08f Jun 24 10:11:10.954727 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Name: tempest-VolumesNegativeTest-943916042 Jun 24 10:11:10.954727 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User: tempest-VolumesNegativeTest-943916042-project Jun 24 10:11:10.954727 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Id: default Jun 24 10:11:10.954727 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Name: Default Jun 24 10:11:10.954727 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Id: 6e45f593afe94604b6fe5c20f050d5c2 Jun 24 10:11:10.954727 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Name: tempest-VolumesNegativeTest-943916042-project Jun 24 10:11:10.954727 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: method: > Jun 24 10:11:10.954727 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: exception: Instance bcd6217e-73a2-4dae-8323-3d4ff56a80e3 could not be found. Jun 24 10:11:10.954727 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: action_args: {'id': 'bcd6217e-73a2-4dae-8323-3d4ff56a80e3'} Jun 24 10:11:10.955622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:11:10.955622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:11:10.955622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:11:10.955622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:11:10.955622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:11:10.955622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:11:10.955622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:11:10.955622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:11:10.955622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:11:10.955622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:11:10.955622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcd6217e-73a2-4dae-8323-3d4ff56a80e3 could not be found. Jun 24 10:11:10.955622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:11:10.955622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:11:10.955622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:11:10.955622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:11:10.955622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:11:10.955622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:11:10.955622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:11:10.955622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:11:10.955622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:11:10.957009 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:11:10.957009 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:11:10.957009 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:11:10.957009 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:11:10.957009 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:11:10.957009 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:11:10.957009 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:11:10.957009 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcd6217e-73a2-4dae-8323-3d4ff56a80e3 could not be found. Jun 24 10:11:10.957009 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:11:10.957009 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:11:10.957009 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:11:10.957009 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:11:10.957009 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:11:10.957009 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:11:10.957009 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:11:10.957009 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:11:10.957009 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcd6217e-73a2-4dae-8323-3d4ff56a80e3 could not be found. Jun 24 10:11:10.957009 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:11:10.958256 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-c59d12b8-783c-4dcb-9f75-bcd71ae136d9 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] Returning 404 to user: Instance bcd6217e-73a2-4dae-8323-3d4ff56a80e3 could not be found. {{(pid=124980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:11:10.958256 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-c59d12b8-783c-4dcb-9f75-bcd71ae136d9 tempest-VolumesNegativeTest-943916042 tempest-VolumesNegativeTest-943916042-project] 10.222.0.26 "GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3" status: 404 len: 111 microversion: 2.1 time: 0.031502 Jun 24 10:11:10.958256 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 494/1011] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:11:10 2022] GET /compute/v2.1/servers/bcd6217e-73a2-4dae-8323-3d4ff56a80e3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 10:11:35.179507 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_api:SELECT=43 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:11:35.180751 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=89 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:11:35.376964 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-a5d34470-3d98-41f2-bf10-394436060d01 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Action: 'create', calling method: .version_select at 0x7f0309ce0dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1923491696", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbQjIYX4Be/v+ZQ86Td+RWXxrntUsiRNVXt/exhq6yCfzN5XDfMk7YYDezevOjCQ5v//spXPsI52scDh7yIyN36ADkyO8vpvj68mAV1n4SUiPGwPFpvUI48oqQx8LoRwA=="}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:11:35.395254 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-a5d34470-3d98-41f2-bf10-394436060d01 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Getting quotas for project 3414c9d5fbfd4397a55c8d03eeb90a19. Resources: {'key_pairs'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:11:35.399865 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-a5d34470-3d98-41f2-bf10-394436060d01 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Getting quotas for user 004ffa1ff356457ba454f5c0ebe69c23 and project 3414c9d5fbfd4397a55c8d03eeb90a19. Resources: {'key_pairs'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:11:35.538253 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-a5d34470-3d98-41f2-bf10-394436060d01 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.366271 Jun 24 10:11:35.538973 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 518/1012] 10.222.0.26 () {60 vars in 1158 bytes} [Fri Jun 24 10:11:35 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:11:36.344794 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-c1670cab-0b26-4131-b56b-9eae5f42750c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:11:36.345751 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-c1670cab-0b26-4131-b56b-9eae5f42750c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:11:36.348971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:11:36.349671 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:11:36.353396 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c1670cab-0b26-4131-b56b-9eae5f42750c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:36.353858 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c1670cab-0b26-4131-b56b-9eae5f42750c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:36.354649 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c1670cab-0b26-4131-b56b-9eae5f42750c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:36.355092 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c1670cab-0b26-4131-b56b-9eae5f42750c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:36.380574 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-c1670cab-0b26-4131-b56b-9eae5f42750c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf/ips" status: 200 len: 150 microversion: 2.1 time: 0.039939 Jun 24 10:11:36.381150 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 495/1013] 10.222.0.26 () {58 vars in 1247 bytes} [Fri Jun 24 10:11:36 2022] GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:11:38.370763 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-777dd4e1-77cc-4c73-9159-3fba6beeaac0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e161722-3cb3-45f0-bd69-69de621e4780"}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:11:38.372486 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-777dd4e1-77cc-4c73-9159-3fba6beeaac0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:11:38.379194 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-777dd4e1-77cc-4c73-9159-3fba6beeaac0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:38.379808 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-777dd4e1-77cc-4c73-9159-3fba6beeaac0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:38.380597 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-777dd4e1-77cc-4c73-9159-3fba6beeaac0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:38.381044 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-777dd4e1-77cc-4c73-9159-3fba6beeaac0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:40.099705 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-777dd4e1-77cc-4c73-9159-3fba6beeaac0 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "POST /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.727361 Jun 24 10:11:40.099705 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 519/1014] 10.222.0.26 () {60 vars in 1322 bytes} [Fri Jun 24 10:11:38 2022] POST /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf/os-volume_attachments => generated 194 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:11:48.209178 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-642e1380-b5fc-444d-bc6e-dea58461370a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:11:48.209884 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-642e1380-b5fc-444d-bc6e-dea58461370a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:11:48.217125 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-642e1380-b5fc-444d-bc6e-dea58461370a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:48.217581 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-642e1380-b5fc-444d-bc6e-dea58461370a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:48.218355 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-642e1380-b5fc-444d-bc6e-dea58461370a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:48.218805 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-642e1380-b5fc-444d-bc6e-dea58461370a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:48.311968 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.objects.instance [None req-642e1380-b5fc-444d-bc6e-dea58461370a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lazy-loading 'services' on Instance uuid 71237ebb-983e-4e90-98f0-447d662211bf {{(pid=124980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:11:48.618722 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-642e1380-b5fc-444d-bc6e-dea58461370a tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "DELETE /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf/os-volume_attachments/3e161722-3cb3-45f0-bd69-69de621e4780" status: 202 len: 0 microversion: 2.1 time: 0.413998 Jun 24 10:11:48.619224 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 496/1015] 10.222.0.26 () {58 vars in 1415 bytes} [Fri Jun 24 10:11:48 2022] DELETE /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf/os-volume_attachments/3e161722-3cb3-45f0-bd69-69de621e4780 => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:11:48.629258 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-51e61bc7-7cfb-4f00-b582-2ef54ff26554 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:11:48.630398 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-51e61bc7-7cfb-4f00-b582-2ef54ff26554 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:11:48.633030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell0:SELECT=4 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:11:48.633717 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:11:48.639521 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-51e61bc7-7cfb-4f00-b582-2ef54ff26554 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:48.639980 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-51e61bc7-7cfb-4f00-b582-2ef54ff26554 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:48.640807 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-51e61bc7-7cfb-4f00-b582-2ef54ff26554 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:48.641249 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-51e61bc7-7cfb-4f00-b582-2ef54ff26554 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:48.672001 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-51e61bc7-7cfb-4f00-b582-2ef54ff26554 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047176 Jun 24 10:11:48.675353 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 520/1016] 10.222.0.26 () {58 vars in 1301 bytes} [Fri Jun 24 10:11:48 2022] GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:11:49.686849 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-1e155d57-bf15-4e35-8919-74343adc97ac tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:11:49.687922 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-1e155d57-bf15-4e35-8919-74343adc97ac tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:11:49.694601 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1e155d57-bf15-4e35-8919-74343adc97ac tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:49.695051 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1e155d57-bf15-4e35-8919-74343adc97ac tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:49.695878 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1e155d57-bf15-4e35-8919-74343adc97ac tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:49.696353 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1e155d57-bf15-4e35-8919-74343adc97ac tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:49.730730 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-1e155d57-bf15-4e35-8919-74343adc97ac tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049052 Jun 24 10:11:49.731579 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 497/1017] 10.222.0.26 () {58 vars in 1301 bytes} [Fri Jun 24 10:11:49 2022] GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:11:50.743775 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-6019adf4-9487-46c7-8a3f-94afac97cc04 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:11:50.744644 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-6019adf4-9487-46c7-8a3f-94afac97cc04 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:11:50.752397 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6019adf4-9487-46c7-8a3f-94afac97cc04 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:50.752846 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6019adf4-9487-46c7-8a3f-94afac97cc04 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:50.753620 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6019adf4-9487-46c7-8a3f-94afac97cc04 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:50.754056 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6019adf4-9487-46c7-8a3f-94afac97cc04 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:50.789468 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-6019adf4-9487-46c7-8a3f-94afac97cc04 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050080 Jun 24 10:11:50.790122 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 521/1018] 10.222.0.26 () {58 vars in 1301 bytes} [Fri Jun 24 10:11:50 2022] GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 10:11:50.850485 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-5e12b195-f5b0-4656-b430-6eb7faa0956c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:11:50.851000 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-5e12b195-f5b0-4656-b430-6eb7faa0956c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:11:50.857541 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5e12b195-f5b0-4656-b430-6eb7faa0956c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:50.870892 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5e12b195-f5b0-4656-b430-6eb7faa0956c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:50.870892 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5e12b195-f5b0-4656-b430-6eb7faa0956c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:50.870892 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5e12b195-f5b0-4656-b430-6eb7faa0956c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:50.886314 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-5e12b195-f5b0-4656-b430-6eb7faa0956c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Going to try to terminate instance {{(pid=124980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:11:51.365115 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-5e12b195-f5b0-4656-b430-6eb7faa0956c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "DELETE /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf" status: 204 len: 0 microversion: 2.1 time: 0.518008 Jun 24 10:11:51.366044 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 498/1019] 10.222.0.26 () {58 vars in 1238 bytes} [Fri Jun 24 10:11:50 2022] DELETE /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:11:51.375596 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-c86ae9b0-3ec1-4582-a531-7e76d4d30cd9 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:11:51.379280 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-c86ae9b0-3ec1-4582-a531-7e76d4d30cd9 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:11:51.382841 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c86ae9b0-3ec1-4582-a531-7e76d4d30cd9 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:51.383447 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c86ae9b0-3ec1-4582-a531-7e76d4d30cd9 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:51.384251 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c86ae9b0-3ec1-4582-a531-7e76d4d30cd9 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:51.384799 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c86ae9b0-3ec1-4582-a531-7e76d4d30cd9 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:51.529826 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-c86ae9b0-3ec1-4582-a531-7e76d4d30cd9 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:11:51.537840 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-c86ae9b0-3ec1-4582-a531-7e76d4d30cd9 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf" status: 200 len: 1682 microversion: 2.1 time: 0.166891 Jun 24 10:11:51.538428 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 522/1020] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:11:51 2022] GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:11:52.557333 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-37eada0f-71f0-40e5-be47-3acb41bfd2db tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:11:52.558122 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-37eada0f-71f0-40e5-be47-3acb41bfd2db tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:11:52.565120 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-37eada0f-71f0-40e5-be47-3acb41bfd2db tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:52.565580 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-37eada0f-71f0-40e5-be47-3acb41bfd2db tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:52.566363 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-37eada0f-71f0-40e5-be47-3acb41bfd2db tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:52.566810 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-37eada0f-71f0-40e5-be47-3acb41bfd2db tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:52.710306 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-37eada0f-71f0-40e5-be47-3acb41bfd2db tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:11:52.718461 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-37eada0f-71f0-40e5-be47-3acb41bfd2db tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf" status: 200 len: 1682 microversion: 2.1 time: 0.166239 Jun 24 10:11:52.719032 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 499/1021] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:11:52 2022] GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:11:53.736392 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-1de1e9e6-ecf0-49c2-a30e-0f26b43f14c5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:11:53.737010 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-1de1e9e6-ecf0-49c2-a30e-0f26b43f14c5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:11:53.743743 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1de1e9e6-ecf0-49c2-a30e-0f26b43f14c5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:53.744356 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1de1e9e6-ecf0-49c2-a30e-0f26b43f14c5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:53.745137 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1de1e9e6-ecf0-49c2-a30e-0f26b43f14c5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:53.745573 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-1de1e9e6-ecf0-49c2-a30e-0f26b43f14c5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:53.824249 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-1de1e9e6-ecf0-49c2-a30e-0f26b43f14c5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:11:53.832216 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-1de1e9e6-ecf0-49c2-a30e-0f26b43f14c5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf" status: 200 len: 1615 microversion: 2.1 time: 0.100147 Jun 24 10:11:53.842639 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 523/1022] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:11:53 2022] GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf => generated 1615 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:11:54.151499 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-005f374e-79ec-4449-aad8-22b612422378 req-c4cd6d8b-938c-4302-8ddb-3922c4cfef31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71237ebb-983e-4e90-98f0-447d662211bf", "name": "network-vif-deleted", "tag": "dda683d8-9678-4843-b72c-ec183c3b9416"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:11:54.166841 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-005f374e-79ec-4449-aad8-22b612422378 req-c4cd6d8b-938c-4302-8ddb-3922c4cfef31 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:54.167585 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-005f374e-79ec-4449-aad8-22b612422378 req-c4cd6d8b-938c-4302-8ddb-3922c4cfef31 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:54.180915 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-005f374e-79ec-4449-aad8-22b612422378 req-c4cd6d8b-938c-4302-8ddb-3922c4cfef31 service nova] Creating event network-vif-deleted:dda683d8-9678-4843-b72c-ec183c3b9416 for instance 71237ebb-983e-4e90-98f0-447d662211bf on hv-cinder-84327 Jun 24 10:11:54.187184 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-005f374e-79ec-4449-aad8-22b612422378 req-c4cd6d8b-938c-4302-8ddb-3922c4cfef31 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120316 Jun 24 10:11:54.187876 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 500/1023] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:11:54.849589 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-65d4605f-084c-4982-be3d-3a2d5d0728d2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:11:54.850238 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-65d4605f-084c-4982-be3d-3a2d5d0728d2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:11:54.859144 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-65d4605f-084c-4982-be3d-3a2d5d0728d2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:54.859612 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-65d4605f-084c-4982-be3d-3a2d5d0728d2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:54.860430 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-65d4605f-084c-4982-be3d-3a2d5d0728d2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:54.860867 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-65d4605f-084c-4982-be3d-3a2d5d0728d2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:54.903392 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-65d4605f-084c-4982-be3d-3a2d5d0728d2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:54.903843 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-65d4605f-084c-4982-be3d-3a2d5d0728d2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:54.904341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.objects.instance [None req-65d4605f-084c-4982-be3d-3a2d5d0728d2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lazy-loading 'fault' on Instance uuid 71237ebb-983e-4e90-98f0-447d662211bf {{(pid=124979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:11:54.948754 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-65d4605f-084c-4982-be3d-3a2d5d0728d2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2c97e68f66142f9b502b215313f7e80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b655c9ef0948c099f60649b9d5e78d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:11:54.957589 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-65d4605f-084c-4982-be3d-3a2d5d0728d2 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf" status: 200 len: 1332 microversion: 2.1 time: 0.111962 Jun 24 10:11:54.958181 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 524/1024] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:11:54 2022] GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf => generated 1332 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:11:55.976238 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-f8dc2777-19df-4fc9-b1e1-c895dc4a5e54 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:11:55.976868 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-f8dc2777-19df-4fc9-b1e1-c895dc4a5e54 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:11:55.983338 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f8dc2777-19df-4fc9-b1e1-c895dc4a5e54 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:55.983791 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f8dc2777-19df-4fc9-b1e1-c895dc4a5e54 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:55.984611 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f8dc2777-19df-4fc9-b1e1-c895dc4a5e54 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:55.985159 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f8dc2777-19df-4fc9-b1e1-c895dc4a5e54 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:56.000449 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.wsgi [None req-f8dc2777-19df-4fc9-b1e1-c895dc4a5e54 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] HTTP exception thrown: Instance 71237ebb-983e-4e90-98f0-447d662211bf could not be found. Jun 24 10:11:56.002100 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-f8dc2777-19df-4fc9-b1e1-c895dc4a5e54 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Request method failure captured: Jun 24 10:11:56.002100 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: request: GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf HTTP/1.1 Jun 24 10:11:56.002100 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept: application/json Jun 24 10:11:56.002100 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept-Encoding: identity Jun 24 10:11:56.002100 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Connection: close Jun 24 10:11:56.002100 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Length: 0 Jun 24 10:11:56.002100 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Type: application/json Jun 24 10:11:56.002100 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Host: 10.222.0.26 Jun 24 10:11:56.002100 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Openstack-System-Scope: None Jun 24 10:11:56.002100 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: User-Agent: python-urllib3/1.26.9 Jun 24 10:11:56.002100 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Auth-Token: gAAAAABitYyzKx6mxHcouBd786V7PSRKtqG7vQygoeml9ZFRI4t-s7SskaI_N7VnM2cMTHq18lI9OepR13ZTFpIKllTjNCYBqowBTJBvubT2uG08oWBo29qBWawe6q0x1WdImPCEss3dF17N9x8N3_7uAMt0BoG5BjapetFSeerYUrODzwv3CBQ Jun 24 10:11:56.002100 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Id: None Jun 24 10:11:56.002100 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Name: None Jun 24 10:11:56.002100 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Identity-Status: Confirmed Jun 24 10:11:56.002100 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Is-Admin-Project: True Jun 24 10:11:56.002100 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Id: default Jun 24 10:11:56.002100 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Name: Default Jun 24 10:11:56.002100 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Id: 64b655c9ef0948c099f60649b9d5e78d Jun 24 10:11:56.002100 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Name: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:11:56.002100 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Role: reader,member Jun 24 10:11:56.002100 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Roles: reader,member Jun 24 10:11:56.003880 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/64b655c9ef0948c099f60649b9d5e78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_64b655c9ef0948c099f60649b9d5e78d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/64b655c9ef0948c099f60649b9d5e78d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/64b655c9ef0948c099f60649b9d5e78d"}]}] Jun 24 10:11:56.003880 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:11:56.003880 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Id: 64b655c9ef0948c099f60649b9d5e78d Jun 24 10:11:56.003880 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:11:56.003880 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User: tempest-AttachVolumeNegativeTest-1676240271-project Jun 24 10:11:56.003880 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Id: default Jun 24 10:11:56.003880 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Name: Default Jun 24 10:11:56.003880 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Id: f2c97e68f66142f9b502b215313f7e80 Jun 24 10:11:56.003880 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Name: tempest-AttachVolumeNegativeTest-1676240271-project Jun 24 10:11:56.003880 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: method: > Jun 24 10:11:56.003880 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: exception: Instance 71237ebb-983e-4e90-98f0-447d662211bf could not be found. Jun 24 10:11:56.003880 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: action_args: {'id': '71237ebb-983e-4e90-98f0-447d662211bf'} Jun 24 10:11:56.004895 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:11:56.004895 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:11:56.004895 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:11:56.004895 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:11:56.004895 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:11:56.004895 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:11:56.004895 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:11:56.004895 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:11:56.004895 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:11:56.004895 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:11:56.004895 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71237ebb-983e-4e90-98f0-447d662211bf could not be found. Jun 24 10:11:56.004895 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:11:56.004895 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:11:56.004895 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:11:56.004895 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:11:56.004895 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:11:56.004895 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:11:56.004895 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:11:56.004895 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:11:56.004895 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:11:56.006590 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:11:56.006590 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:11:56.006590 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:11:56.006590 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:11:56.006590 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:11:56.006590 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:11:56.006590 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:11:56.006590 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71237ebb-983e-4e90-98f0-447d662211bf could not be found. Jun 24 10:11:56.006590 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:11:56.006590 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:11:56.006590 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:11:56.006590 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:11:56.006590 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:11:56.006590 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:11:56.006590 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:11:56.006590 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:11:56.006590 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71237ebb-983e-4e90-98f0-447d662211bf could not be found. Jun 24 10:11:56.006590 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:11:56.008352 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-f8dc2777-19df-4fc9-b1e1-c895dc4a5e54 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Returning 404 to user: Instance 71237ebb-983e-4e90-98f0-447d662211bf could not be found. {{(pid=124980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:11:56.008352 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-f8dc2777-19df-4fc9-b1e1-c895dc4a5e54 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf" status: 404 len: 111 microversion: 2.1 time: 0.032246 Jun 24 10:11:56.008352 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 501/1025] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:11:55 2022] GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:11:56.013503 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-3b283a05-a38a-4a94-9beb-128b06a42448 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '.version_select at 0x7f03099bf670>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:11:56.103084 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-3b283a05-a38a-4a94-9beb-128b06a42448 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2052135789" status: 202 len: 0 microversion: 2.1 time: 0.093457 Jun 24 10:11:56.103714 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 525/1026] 10.222.0.26 () {58 vars in 1220 bytes} [Fri Jun 24 10:11:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2052135789 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:11:58.384858 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-26e37c61-712d-4447-b785-de9800cbc9dd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2119738107", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1923491696", "security_groups": [{"name": "tempest-secgroup-smoke-1253772007"}], "networks": [{"uuid": "f789a03c-b019-4c7a-8476-7691a938dc64"}], "block_device_mapping_v2": [{"uuid": "64786836-7c71-4034-9457-2bc2705f74f8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:11:58.413559 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-5b3ab309-3bfc-41ff-9874-9d57682c0342 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:11:58.414042 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-5b3ab309-3bfc-41ff-9874-9d57682c0342 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:11:58.422225 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5b3ab309-3bfc-41ff-9874-9d57682c0342 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:58.422667 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5b3ab309-3bfc-41ff-9874-9d57682c0342 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:58.423560 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5b3ab309-3bfc-41ff-9874-9d57682c0342 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:58.423930 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5b3ab309-3bfc-41ff-9874-9d57682c0342 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:58.444899 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-5b3ab309-3bfc-41ff-9874-9d57682c0342 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] HTTP exception thrown: Instance 71237ebb-983e-4e90-98f0-447d662211bf could not be found. Jun 24 10:11:58.444899 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-5b3ab309-3bfc-41ff-9874-9d57682c0342 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Request method failure captured: Jun 24 10:11:58.444899 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: DELETE /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf HTTP/1.1 Jun 24 10:11:58.444899 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:11:58.444899 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:11:58.444899 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:11:58.444899 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 0 Jun 24 10:11:58.444899 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:11:58.444899 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:11:58.444899 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:11:58.444899 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:11:58.444899 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitYyzKx6mxHcouBd786V7PSRKtqG7vQygoeml9ZFRI4t-s7SskaI_N7VnM2cMTHq18lI9OepR13ZTFpIKllTjNCYBqowBTJBvubT2uG08oWBo29qBWawe6q0x1WdImPCEss3dF17N9x8N3_7uAMt0BoG5BjapetFSeerYUrODzwv3CBQ Jun 24 10:11:58.444899 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:11:58.444899 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:11:58.444899 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:11:58.444899 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:11:58.444899 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:11:58.444899 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:11:58.444899 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: 64b655c9ef0948c099f60649b9d5e78d Jun 24 10:11:58.444899 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:11:58.444899 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:11:58.444899 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:11:58.446705 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/64b655c9ef0948c099f60649b9d5e78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_64b655c9ef0948c099f60649b9d5e78d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/64b655c9ef0948c099f60649b9d5e78d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/64b655c9ef0948c099f60649b9d5e78d"}]}] Jun 24 10:11:58.446705 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:11:58.446705 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: 64b655c9ef0948c099f60649b9d5e78d Jun 24 10:11:58.446705 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:11:58.446705 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-AttachVolumeNegativeTest-1676240271-project Jun 24 10:11:58.446705 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:11:58.446705 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:11:58.446705 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: f2c97e68f66142f9b502b215313f7e80 Jun 24 10:11:58.446705 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-AttachVolumeNegativeTest-1676240271-project Jun 24 10:11:58.446705 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: > Jun 24 10:11:58.446705 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Instance 71237ebb-983e-4e90-98f0-447d662211bf could not be found. Jun 24 10:11:58.446705 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'id': '71237ebb-983e-4e90-98f0-447d662211bf'} Jun 24 10:11:58.447693 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:11:58.447693 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:11:58.447693 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:11:58.447693 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:11:58.447693 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:11:58.447693 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:11:58.447693 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:11:58.447693 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:11:58.447693 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:11:58.447693 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:11:58.447693 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71237ebb-983e-4e90-98f0-447d662211bf could not be found. Jun 24 10:11:58.447693 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:11:58.447693 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:11:58.447693 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:11:58.447693 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:11:58.447693 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:11:58.447693 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:11:58.447693 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:11:58.447693 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:11:58.447693 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:11:58.449192 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:11:58.449192 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 10:11:58.449192 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 10:11:58.449192 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 10:11:58.449192 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 10:11:58.449192 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:11:58.449192 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:11:58.449192 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:11:58.449192 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:11:58.449192 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71237ebb-983e-4e90-98f0-447d662211bf could not be found. Jun 24 10:11:58.449192 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:11:58.449192 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:11:58.449192 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:11:58.449192 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:11:58.449192 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:11:58.449192 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:11:58.449192 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:11:58.449192 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:11:58.449192 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71237ebb-983e-4e90-98f0-447d662211bf could not be found. Jun 24 10:11:58.449192 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:11:58.450701 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-5b3ab309-3bfc-41ff-9874-9d57682c0342 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Returning 404 to user: Instance 71237ebb-983e-4e90-98f0-447d662211bf could not be found. {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:11:58.450701 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-5b3ab309-3bfc-41ff-9874-9d57682c0342 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "DELETE /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf" status: 404 len: 111 microversion: 2.1 time: 0.032782 Jun 24 10:11:58.450701 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 526/1027] 10.222.0.26 () {58 vars in 1238 bytes} [Fri Jun 24 10:11:58 2022] DELETE /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:11:58.452938 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-7abf65cc-5c18-4e52-9208-65ca4ba0abe5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:11:58.455161 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-7abf65cc-5c18-4e52-9208-65ca4ba0abe5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: 71237ebb-983e-4e90-98f0-447d662211bf] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:11:58.460429 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7abf65cc-5c18-4e52-9208-65ca4ba0abe5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:58.460874 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7abf65cc-5c18-4e52-9208-65ca4ba0abe5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:58.461935 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7abf65cc-5c18-4e52-9208-65ca4ba0abe5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:58.462060 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7abf65cc-5c18-4e52-9208-65ca4ba0abe5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:58.477370 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-7abf65cc-5c18-4e52-9208-65ca4ba0abe5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] HTTP exception thrown: Instance 71237ebb-983e-4e90-98f0-447d662211bf could not be found. Jun 24 10:11:58.479302 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-7abf65cc-5c18-4e52-9208-65ca4ba0abe5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Request method failure captured: Jun 24 10:11:58.479302 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf HTTP/1.1 Jun 24 10:11:58.479302 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:11:58.479302 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:11:58.479302 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:11:58.479302 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 0 Jun 24 10:11:58.479302 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:11:58.479302 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:11:58.479302 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:11:58.479302 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:11:58.479302 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitYyzKx6mxHcouBd786V7PSRKtqG7vQygoeml9ZFRI4t-s7SskaI_N7VnM2cMTHq18lI9OepR13ZTFpIKllTjNCYBqowBTJBvubT2uG08oWBo29qBWawe6q0x1WdImPCEss3dF17N9x8N3_7uAMt0BoG5BjapetFSeerYUrODzwv3CBQ Jun 24 10:11:58.479302 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:11:58.479302 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:11:58.479302 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:11:58.479302 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:11:58.479302 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:11:58.479302 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:11:58.479302 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: 64b655c9ef0948c099f60649b9d5e78d Jun 24 10:11:58.479302 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:11:58.479302 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:11:58.479302 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:11:58.481110 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/64b655c9ef0948c099f60649b9d5e78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_64b655c9ef0948c099f60649b9d5e78d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/64b655c9ef0948c099f60649b9d5e78d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/64b655c9ef0948c099f60649b9d5e78d"}]}] Jun 24 10:11:58.481110 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:11:58.481110 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: 64b655c9ef0948c099f60649b9d5e78d Jun 24 10:11:58.481110 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:11:58.481110 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-AttachVolumeNegativeTest-1676240271-project Jun 24 10:11:58.481110 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:11:58.481110 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:11:58.481110 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: f2c97e68f66142f9b502b215313f7e80 Jun 24 10:11:58.481110 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-AttachVolumeNegativeTest-1676240271-project Jun 24 10:11:58.481110 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: > Jun 24 10:11:58.481110 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Instance 71237ebb-983e-4e90-98f0-447d662211bf could not be found. Jun 24 10:11:58.481110 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'id': '71237ebb-983e-4e90-98f0-447d662211bf'} Jun 24 10:11:58.482017 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:11:58.482017 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:11:58.482017 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:11:58.482017 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:11:58.482017 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:11:58.482017 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:11:58.482017 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:11:58.482017 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:11:58.482017 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:11:58.482017 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:11:58.482017 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71237ebb-983e-4e90-98f0-447d662211bf could not be found. Jun 24 10:11:58.482017 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:11:58.482017 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:11:58.482017 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:11:58.482017 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:11:58.482017 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:11:58.482017 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:11:58.482017 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:11:58.482017 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:11:58.482017 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:11:58.483368 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:11:58.483368 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:11:58.483368 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:11:58.483368 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:11:58.483368 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:11:58.483368 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:11:58.483368 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:11:58.483368 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71237ebb-983e-4e90-98f0-447d662211bf could not be found. Jun 24 10:11:58.483368 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:11:58.483368 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:11:58.483368 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:11:58.483368 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:11:58.483368 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:11:58.483368 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:11:58.483368 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:11:58.483368 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:11:58.483368 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71237ebb-983e-4e90-98f0-447d662211bf could not be found. Jun 24 10:11:58.483368 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:11:58.484757 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-7abf65cc-5c18-4e52-9208-65ca4ba0abe5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Returning 404 to user: Instance 71237ebb-983e-4e90-98f0-447d662211bf could not be found. {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:11:58.484757 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-7abf65cc-5c18-4e52-9208-65ca4ba0abe5 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf" status: 404 len: 111 microversion: 2.1 time: 0.032855 Jun 24 10:11:58.484757 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 527/1028] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:11:58 2022] GET /compute/v2.1/servers/71237ebb-983e-4e90-98f0-447d662211bf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 10:11:58.522215 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.network.neutron [None req-26e37c61-712d-4447-b785-de9800cbc9dd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] validate_networks() for [('f789a03c-b019-4c7a-8476-7691a938dc64', None, None, None, None, None)] {{(pid=124980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:11:58.939989 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-26e37c61-712d-4447-b785-de9800cbc9dd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Flavor limits 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:11:58.940476 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-26e37c61-712d-4447-b785-de9800cbc9dd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Image limits 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:11:58.940986 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-26e37c61-712d-4447-b785-de9800cbc9dd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Flavor pref 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:11:58.941367 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-26e37c61-712d-4447-b785-de9800cbc9dd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Image pref 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:11:58.941799 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-26e37c61-712d-4447-b785-de9800cbc9dd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:11:58.952458 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-26e37c61-712d-4447-b785-de9800cbc9dd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:58.952947 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-26e37c61-712d-4447-b785-de9800cbc9dd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:58.953776 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-26e37c61-712d-4447-b785-de9800cbc9dd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:58.954215 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-26e37c61-712d-4447-b785-de9800cbc9dd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:58.972192 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-26e37c61-712d-4447-b785-de9800cbc9dd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Getting quotas for project 3414c9d5fbfd4397a55c8d03eeb90a19. Resources: {'instances', 'cores', 'ram'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:11:58.978205 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-26e37c61-712d-4447-b785-de9800cbc9dd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Getting quotas for user 004ffa1ff356457ba454f5c0ebe69c23 and project 3414c9d5fbfd4397a55c8d03eeb90a19. Resources: {'instances', 'cores', 'ram'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:11:59.049170 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-26e37c61-712d-4447-b785-de9800cbc9dd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Going to run 1 instances... {{(pid=124980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:11:59.051377 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-26e37c61-712d-4447-b785-de9800cbc9dd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='64786836-7c71-4034-9457-2bc2705f74f8',volume_size=None,volume_type=None)] {{(pid=124980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:11:59.693179 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-26e37c61-712d-4447-b785-de9800cbc9dd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.312230 Jun 24 10:11:59.693879 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 502/1029] 10.222.0.26 () {60 vars in 1146 bytes} [Fri Jun 24 10:11:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:11:59.704282 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-2ccfed31-08b1-4224-8736-c667486c5c3e tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:11:59.705137 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-2ccfed31-08b1-4224-8736-c667486c5c3e tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:11:59.763973 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-2ccfed31-08b1-4224-8736-c667486c5c3e tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:11:59.771232 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-2ccfed31-08b1-4224-8736-c667486c5c3e tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1089 microversion: 2.1 time: 0.070986 Jun 24 10:11:59.771795 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 528/1030] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:11:59 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1089 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:11:59.810287 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-735e9532-dde2-4146-9ca7-88ce61824f65 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:11:59.811367 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-735e9532-dde2-4146-9ca7-88ce61824f65 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:11:59.817962 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-735e9532-dde2-4146-9ca7-88ce61824f65 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:59.818486 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-735e9532-dde2-4146-9ca7-88ce61824f65 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:59.819373 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-735e9532-dde2-4146-9ca7-88ce61824f65 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:59.819878 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-735e9532-dde2-4146-9ca7-88ce61824f65 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:59.833792 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.wsgi [None req-735e9532-dde2-4146-9ca7-88ce61824f65 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] HTTP exception thrown: Instance be64c134-2849-4168-8e6d-ba3cef4f3123 could not be found. Jun 24 10:11:59.835496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-735e9532-dde2-4146-9ca7-88ce61824f65 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Request method failure captured: Jun 24 10:11:59.835496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: request: DELETE /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123 HTTP/1.1 Jun 24 10:11:59.835496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept: application/json Jun 24 10:11:59.835496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept-Encoding: identity Jun 24 10:11:59.835496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Connection: close Jun 24 10:11:59.835496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Length: 0 Jun 24 10:11:59.835496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Type: application/json Jun 24 10:11:59.835496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Host: 10.222.0.26 Jun 24 10:11:59.835496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Openstack-System-Scope: None Jun 24 10:11:59.835496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: User-Agent: python-urllib3/1.26.9 Jun 24 10:11:59.835496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Auth-Token: gAAAAABitYyzKx6mxHcouBd786V7PSRKtqG7vQygoeml9ZFRI4t-s7SskaI_N7VnM2cMTHq18lI9OepR13ZTFpIKllTjNCYBqowBTJBvubT2uG08oWBo29qBWawe6q0x1WdImPCEss3dF17N9x8N3_7uAMt0BoG5BjapetFSeerYUrODzwv3CBQ Jun 24 10:11:59.835496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Id: None Jun 24 10:11:59.835496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Name: None Jun 24 10:11:59.835496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Identity-Status: Confirmed Jun 24 10:11:59.835496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Is-Admin-Project: True Jun 24 10:11:59.835496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Id: default Jun 24 10:11:59.835496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Name: Default Jun 24 10:11:59.835496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Id: 64b655c9ef0948c099f60649b9d5e78d Jun 24 10:11:59.835496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Name: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:11:59.835496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Role: reader,member Jun 24 10:11:59.835496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Roles: reader,member Jun 24 10:11:59.837177 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/64b655c9ef0948c099f60649b9d5e78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_64b655c9ef0948c099f60649b9d5e78d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/64b655c9ef0948c099f60649b9d5e78d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/64b655c9ef0948c099f60649b9d5e78d"}]}] Jun 24 10:11:59.837177 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:11:59.837177 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Id: 64b655c9ef0948c099f60649b9d5e78d Jun 24 10:11:59.837177 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:11:59.837177 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User: tempest-AttachVolumeNegativeTest-1676240271-project Jun 24 10:11:59.837177 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Id: default Jun 24 10:11:59.837177 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Name: Default Jun 24 10:11:59.837177 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Id: f2c97e68f66142f9b502b215313f7e80 Jun 24 10:11:59.837177 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Name: tempest-AttachVolumeNegativeTest-1676240271-project Jun 24 10:11:59.837177 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: method: > Jun 24 10:11:59.837177 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: exception: Instance be64c134-2849-4168-8e6d-ba3cef4f3123 could not be found. Jun 24 10:11:59.837177 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: action_args: {'id': 'be64c134-2849-4168-8e6d-ba3cef4f3123'} Jun 24 10:11:59.840339 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:11:59.840339 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:11:59.840339 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:11:59.840339 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:11:59.840339 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:11:59.840339 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:11:59.840339 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:11:59.840339 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:11:59.840339 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:11:59.840339 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:11:59.840339 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be64c134-2849-4168-8e6d-ba3cef4f3123 could not be found. Jun 24 10:11:59.840339 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:11:59.840339 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:11:59.840339 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:11:59.840339 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:11:59.840339 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:11:59.840339 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:11:59.840339 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:11:59.840339 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:11:59.840339 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:11:59.841782 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:11:59.841782 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 10:11:59.841782 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 10:11:59.841782 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 10:11:59.841782 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 10:11:59.841782 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:11:59.841782 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:11:59.841782 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:11:59.841782 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:11:59.841782 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be64c134-2849-4168-8e6d-ba3cef4f3123 could not be found. Jun 24 10:11:59.841782 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:11:59.841782 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:11:59.841782 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:11:59.841782 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:11:59.841782 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:11:59.841782 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:11:59.841782 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:11:59.841782 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:11:59.841782 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be64c134-2849-4168-8e6d-ba3cef4f3123 could not be found. Jun 24 10:11:59.841782 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:11:59.843412 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-735e9532-dde2-4146-9ca7-88ce61824f65 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Returning 404 to user: Instance be64c134-2849-4168-8e6d-ba3cef4f3123 could not be found. {{(pid=124980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:11:59.843412 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-735e9532-dde2-4146-9ca7-88ce61824f65 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "DELETE /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123" status: 404 len: 111 microversion: 2.1 time: 0.030776 Jun 24 10:11:59.843412 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 503/1031] 10.222.0.26 () {58 vars in 1238 bytes} [Fri Jun 24 10:11:59 2022] DELETE /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:11:59.847626 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-3a22e28b-8cb5-4748-a1d3-d7d1705e65d4 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:11:59.848353 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-3a22e28b-8cb5-4748-a1d3-d7d1705e65d4 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: be64c134-2849-4168-8e6d-ba3cef4f3123] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:11:59.855548 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3a22e28b-8cb5-4748-a1d3-d7d1705e65d4 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:59.855999 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3a22e28b-8cb5-4748-a1d3-d7d1705e65d4 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:59.856793 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3a22e28b-8cb5-4748-a1d3-d7d1705e65d4 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:59.857228 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3a22e28b-8cb5-4748-a1d3-d7d1705e65d4 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:59.874738 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-3a22e28b-8cb5-4748-a1d3-d7d1705e65d4 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] HTTP exception thrown: Instance be64c134-2849-4168-8e6d-ba3cef4f3123 could not be found. Jun 24 10:11:59.875217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-3a22e28b-8cb5-4748-a1d3-d7d1705e65d4 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Request method failure captured: Jun 24 10:11:59.875217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123 HTTP/1.1 Jun 24 10:11:59.875217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:11:59.875217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:11:59.875217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:11:59.875217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 0 Jun 24 10:11:59.875217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:11:59.875217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:11:59.875217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:11:59.875217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:11:59.875217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitYyzKx6mxHcouBd786V7PSRKtqG7vQygoeml9ZFRI4t-s7SskaI_N7VnM2cMTHq18lI9OepR13ZTFpIKllTjNCYBqowBTJBvubT2uG08oWBo29qBWawe6q0x1WdImPCEss3dF17N9x8N3_7uAMt0BoG5BjapetFSeerYUrODzwv3CBQ Jun 24 10:11:59.875217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:11:59.875217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:11:59.875217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:11:59.875217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:11:59.875217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:11:59.875217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:11:59.875217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: 64b655c9ef0948c099f60649b9d5e78d Jun 24 10:11:59.875217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:11:59.875217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:11:59.875217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:11:59.877152 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/64b655c9ef0948c099f60649b9d5e78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_64b655c9ef0948c099f60649b9d5e78d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/64b655c9ef0948c099f60649b9d5e78d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/64b655c9ef0948c099f60649b9d5e78d"}]}] Jun 24 10:11:59.877152 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:11:59.877152 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: 64b655c9ef0948c099f60649b9d5e78d Jun 24 10:11:59.877152 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:11:59.877152 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-AttachVolumeNegativeTest-1676240271-project Jun 24 10:11:59.877152 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:11:59.877152 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:11:59.877152 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: f2c97e68f66142f9b502b215313f7e80 Jun 24 10:11:59.877152 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-AttachVolumeNegativeTest-1676240271-project Jun 24 10:11:59.877152 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: > Jun 24 10:11:59.877152 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Instance be64c134-2849-4168-8e6d-ba3cef4f3123 could not be found. Jun 24 10:11:59.877152 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'id': 'be64c134-2849-4168-8e6d-ba3cef4f3123'} Jun 24 10:11:59.877925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:11:59.877925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:11:59.877925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:11:59.877925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:11:59.877925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:11:59.877925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:11:59.877925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:11:59.877925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:11:59.877925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:11:59.877925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:11:59.877925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be64c134-2849-4168-8e6d-ba3cef4f3123 could not be found. Jun 24 10:11:59.877925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:11:59.877925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:11:59.877925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:11:59.877925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:11:59.877925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:11:59.877925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:11:59.877925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:11:59.877925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:11:59.877925 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:11:59.879838 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:11:59.879838 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:11:59.879838 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:11:59.879838 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:11:59.879838 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:11:59.879838 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:11:59.879838 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:11:59.879838 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be64c134-2849-4168-8e6d-ba3cef4f3123 could not be found. Jun 24 10:11:59.879838 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:11:59.879838 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:11:59.879838 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:11:59.879838 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:11:59.879838 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:11:59.879838 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:11:59.879838 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:11:59.879838 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:11:59.879838 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be64c134-2849-4168-8e6d-ba3cef4f3123 could not be found. Jun 24 10:11:59.879838 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:11:59.882523 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-3a22e28b-8cb5-4748-a1d3-d7d1705e65d4 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Returning 404 to user: Instance be64c134-2849-4168-8e6d-ba3cef4f3123 could not be found. {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:11:59.882523 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-3a22e28b-8cb5-4748-a1d3-d7d1705e65d4 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123" status: 404 len: 111 microversion: 2.1 time: 0.033478 Jun 24 10:11:59.882523 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 529/1032] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:11:59 2022] GET /compute/v2.1/servers/be64c134-2849-4168-8e6d-ba3cef4f3123 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:11:59.890232 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-36c15ab8-2c58-463d-bd15-5d10c21d6f1c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:11:59.891438 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-36c15ab8-2c58-463d-bd15-5d10c21d6f1c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:11:59.899956 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-36c15ab8-2c58-463d-bd15-5d10c21d6f1c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:59.900435 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-36c15ab8-2c58-463d-bd15-5d10c21d6f1c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:59.901206 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-36c15ab8-2c58-463d-bd15-5d10c21d6f1c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:59.901640 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-36c15ab8-2c58-463d-bd15-5d10c21d6f1c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:59.916217 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.wsgi [None req-36c15ab8-2c58-463d-bd15-5d10c21d6f1c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] HTTP exception thrown: Instance f866b577-5318-4708-a475-c7121b57d3e9 could not be found. Jun 24 10:11:59.917882 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-36c15ab8-2c58-463d-bd15-5d10c21d6f1c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Request method failure captured: Jun 24 10:11:59.917882 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: request: DELETE /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 HTTP/1.1 Jun 24 10:11:59.917882 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept: application/json Jun 24 10:11:59.917882 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept-Encoding: identity Jun 24 10:11:59.917882 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Connection: close Jun 24 10:11:59.917882 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Length: 0 Jun 24 10:11:59.917882 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Type: application/json Jun 24 10:11:59.917882 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Host: 10.222.0.26 Jun 24 10:11:59.917882 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Openstack-System-Scope: None Jun 24 10:11:59.917882 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: User-Agent: python-urllib3/1.26.9 Jun 24 10:11:59.917882 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Auth-Token: gAAAAABitYyzKx6mxHcouBd786V7PSRKtqG7vQygoeml9ZFRI4t-s7SskaI_N7VnM2cMTHq18lI9OepR13ZTFpIKllTjNCYBqowBTJBvubT2uG08oWBo29qBWawe6q0x1WdImPCEss3dF17N9x8N3_7uAMt0BoG5BjapetFSeerYUrODzwv3CBQ Jun 24 10:11:59.917882 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Id: None Jun 24 10:11:59.917882 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Name: None Jun 24 10:11:59.917882 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Identity-Status: Confirmed Jun 24 10:11:59.917882 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Is-Admin-Project: True Jun 24 10:11:59.917882 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Id: default Jun 24 10:11:59.917882 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Name: Default Jun 24 10:11:59.917882 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Id: 64b655c9ef0948c099f60649b9d5e78d Jun 24 10:11:59.917882 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Name: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:11:59.917882 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Role: reader,member Jun 24 10:11:59.917882 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Roles: reader,member Jun 24 10:11:59.919246 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/64b655c9ef0948c099f60649b9d5e78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_64b655c9ef0948c099f60649b9d5e78d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/64b655c9ef0948c099f60649b9d5e78d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/64b655c9ef0948c099f60649b9d5e78d"}]}] Jun 24 10:11:59.919246 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:11:59.919246 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Id: 64b655c9ef0948c099f60649b9d5e78d Jun 24 10:11:59.919246 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:11:59.919246 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User: tempest-AttachVolumeNegativeTest-1676240271-project Jun 24 10:11:59.919246 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Id: default Jun 24 10:11:59.919246 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Name: Default Jun 24 10:11:59.919246 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Id: f2c97e68f66142f9b502b215313f7e80 Jun 24 10:11:59.919246 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Name: tempest-AttachVolumeNegativeTest-1676240271-project Jun 24 10:11:59.919246 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: method: > Jun 24 10:11:59.919246 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: exception: Instance f866b577-5318-4708-a475-c7121b57d3e9 could not be found. Jun 24 10:11:59.919246 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: action_args: {'id': 'f866b577-5318-4708-a475-c7121b57d3e9'} Jun 24 10:11:59.921867 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:11:59.921867 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:11:59.921867 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:11:59.921867 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:11:59.921867 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:11:59.921867 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:11:59.921867 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:11:59.921867 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:11:59.921867 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:11:59.921867 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:11:59.921867 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f866b577-5318-4708-a475-c7121b57d3e9 could not be found. Jun 24 10:11:59.921867 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:11:59.921867 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:11:59.921867 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:11:59.921867 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:11:59.921867 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:11:59.921867 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:11:59.921867 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:11:59.921867 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:11:59.921867 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:11:59.924610 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:11:59.924610 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 10:11:59.924610 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 10:11:59.924610 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 10:11:59.924610 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 10:11:59.924610 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:11:59.924610 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:11:59.924610 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:11:59.924610 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:11:59.924610 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f866b577-5318-4708-a475-c7121b57d3e9 could not be found. Jun 24 10:11:59.924610 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:11:59.924610 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:11:59.924610 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:11:59.924610 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:11:59.924610 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:11:59.924610 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:11:59.924610 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:11:59.924610 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:11:59.924610 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f866b577-5318-4708-a475-c7121b57d3e9 could not be found. Jun 24 10:11:59.924610 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:11:59.926442 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-36c15ab8-2c58-463d-bd15-5d10c21d6f1c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Returning 404 to user: Instance f866b577-5318-4708-a475-c7121b57d3e9 could not be found. {{(pid=124980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:11:59.926442 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-36c15ab8-2c58-463d-bd15-5d10c21d6f1c tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9" status: 404 len: 111 microversion: 2.1 time: 0.035749 Jun 24 10:11:59.926442 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 504/1033] 10.222.0.26 () {58 vars in 1238 bytes} [Fri Jun 24 10:11:59 2022] DELETE /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:11:59.929895 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-7e04b5ec-0460-4360-b544-c388bad04723 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:11:59.930505 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-7e04b5ec-0460-4360-b544-c388bad04723 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f866b577-5318-4708-a475-c7121b57d3e9] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:11:59.938082 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7e04b5ec-0460-4360-b544-c388bad04723 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:59.938082 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7e04b5ec-0460-4360-b544-c388bad04723 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:59.938562 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7e04b5ec-0460-4360-b544-c388bad04723 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:11:59.938996 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7e04b5ec-0460-4360-b544-c388bad04723 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:11:59.954928 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-7e04b5ec-0460-4360-b544-c388bad04723 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] HTTP exception thrown: Instance f866b577-5318-4708-a475-c7121b57d3e9 could not be found. Jun 24 10:11:59.956438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-7e04b5ec-0460-4360-b544-c388bad04723 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Request method failure captured: Jun 24 10:11:59.956438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 HTTP/1.1 Jun 24 10:11:59.956438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:11:59.956438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:11:59.956438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:11:59.956438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 0 Jun 24 10:11:59.956438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:11:59.956438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:11:59.956438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:11:59.956438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:11:59.956438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitYyzKx6mxHcouBd786V7PSRKtqG7vQygoeml9ZFRI4t-s7SskaI_N7VnM2cMTHq18lI9OepR13ZTFpIKllTjNCYBqowBTJBvubT2uG08oWBo29qBWawe6q0x1WdImPCEss3dF17N9x8N3_7uAMt0BoG5BjapetFSeerYUrODzwv3CBQ Jun 24 10:11:59.956438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:11:59.956438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:11:59.956438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:11:59.956438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:11:59.956438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:11:59.956438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:11:59.956438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: 64b655c9ef0948c099f60649b9d5e78d Jun 24 10:11:59.956438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:11:59.956438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:11:59.956438 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:11:59.959751 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/64b655c9ef0948c099f60649b9d5e78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_64b655c9ef0948c099f60649b9d5e78d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/64b655c9ef0948c099f60649b9d5e78d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/64b655c9ef0948c099f60649b9d5e78d"}]}] Jun 24 10:11:59.959751 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:11:59.959751 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: 64b655c9ef0948c099f60649b9d5e78d Jun 24 10:11:59.959751 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:11:59.959751 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-AttachVolumeNegativeTest-1676240271-project Jun 24 10:11:59.959751 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:11:59.959751 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:11:59.959751 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: f2c97e68f66142f9b502b215313f7e80 Jun 24 10:11:59.959751 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-AttachVolumeNegativeTest-1676240271-project Jun 24 10:11:59.959751 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: > Jun 24 10:11:59.959751 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Instance f866b577-5318-4708-a475-c7121b57d3e9 could not be found. Jun 24 10:11:59.959751 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'id': 'f866b577-5318-4708-a475-c7121b57d3e9'} Jun 24 10:11:59.963140 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:11:59.963140 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:11:59.963140 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:11:59.963140 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:11:59.963140 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:11:59.963140 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:11:59.963140 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:11:59.963140 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:11:59.963140 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:11:59.963140 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:11:59.963140 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f866b577-5318-4708-a475-c7121b57d3e9 could not be found. Jun 24 10:11:59.963140 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:11:59.963140 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:11:59.963140 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:11:59.963140 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:11:59.963140 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:11:59.963140 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:11:59.963140 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:11:59.963140 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:11:59.963140 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:11:59.966833 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:11:59.966833 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:11:59.966833 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:11:59.966833 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:11:59.966833 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:11:59.966833 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:11:59.966833 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:11:59.966833 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f866b577-5318-4708-a475-c7121b57d3e9 could not be found. Jun 24 10:11:59.966833 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:11:59.966833 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:11:59.966833 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:11:59.966833 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:11:59.966833 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:11:59.966833 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:11:59.966833 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:11:59.966833 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:11:59.966833 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f866b577-5318-4708-a475-c7121b57d3e9 could not be found. Jun 24 10:11:59.966833 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:11:59.969627 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-7e04b5ec-0460-4360-b544-c388bad04723 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Returning 404 to user: Instance f866b577-5318-4708-a475-c7121b57d3e9 could not be found. {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:11:59.969627 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-7e04b5ec-0460-4360-b544-c388bad04723 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9" status: 404 len: 111 microversion: 2.1 time: 0.032280 Jun 24 10:11:59.969627 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 530/1034] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:11:59 2022] GET /compute/v2.1/servers/f866b577-5318-4708-a475-c7121b57d3e9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:12:00.788523 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-b7e01312-b12b-45b7-86ca-d2cb86a775f7 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:12:00.789397 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-b7e01312-b12b-45b7-86ca-d2cb86a775f7 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:12:00.844154 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-b7e01312-b12b-45b7-86ca-d2cb86a775f7 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:12:00.851189 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-b7e01312-b12b-45b7-86ca-d2cb86a775f7 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1089 microversion: 2.1 time: 0.066850 Jun 24 10:12:00.851755 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 505/1035] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:12:00 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1089 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:12:01.460308 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-5adffb45-95d9-4c38-8155-01ed827106f7 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:12:01.460308 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-5adffb45-95d9-4c38-8155-01ed827106f7 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:12:01.460308 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5adffb45-95d9-4c38-8155-01ed827106f7 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:01.460308 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5adffb45-95d9-4c38-8155-01ed827106f7 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:01.461413 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5adffb45-95d9-4c38-8155-01ed827106f7 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:01.461413 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-5adffb45-95d9-4c38-8155-01ed827106f7 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:01.475884 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-5adffb45-95d9-4c38-8155-01ed827106f7 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] HTTP exception thrown: Instance f0aef362-32c9-463b-ba31-93ce5c561487 could not be found. Jun 24 10:12:01.477496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-5adffb45-95d9-4c38-8155-01ed827106f7 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Request method failure captured: Jun 24 10:12:01.477496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: DELETE /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487 HTTP/1.1 Jun 24 10:12:01.477496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:12:01.477496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:12:01.477496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:12:01.477496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 0 Jun 24 10:12:01.477496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:12:01.477496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:12:01.477496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:12:01.477496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:12:01.477496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitYyzKx6mxHcouBd786V7PSRKtqG7vQygoeml9ZFRI4t-s7SskaI_N7VnM2cMTHq18lI9OepR13ZTFpIKllTjNCYBqowBTJBvubT2uG08oWBo29qBWawe6q0x1WdImPCEss3dF17N9x8N3_7uAMt0BoG5BjapetFSeerYUrODzwv3CBQ Jun 24 10:12:01.477496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:12:01.477496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:12:01.477496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:12:01.477496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:12:01.477496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:12:01.477496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:12:01.477496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: 64b655c9ef0948c099f60649b9d5e78d Jun 24 10:12:01.477496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:12:01.477496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:12:01.477496 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:12:01.479238 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/64b655c9ef0948c099f60649b9d5e78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_64b655c9ef0948c099f60649b9d5e78d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/64b655c9ef0948c099f60649b9d5e78d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/64b655c9ef0948c099f60649b9d5e78d"}]}] Jun 24 10:12:01.479238 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:12:01.479238 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: 64b655c9ef0948c099f60649b9d5e78d Jun 24 10:12:01.479238 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:12:01.479238 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-AttachVolumeNegativeTest-1676240271-project Jun 24 10:12:01.479238 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:12:01.479238 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:12:01.479238 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: f2c97e68f66142f9b502b215313f7e80 Jun 24 10:12:01.479238 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-AttachVolumeNegativeTest-1676240271-project Jun 24 10:12:01.479238 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: > Jun 24 10:12:01.479238 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Instance f0aef362-32c9-463b-ba31-93ce5c561487 could not be found. Jun 24 10:12:01.479238 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'id': 'f0aef362-32c9-463b-ba31-93ce5c561487'} Jun 24 10:12:01.480147 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:12:01.480147 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:12:01.480147 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:12:01.480147 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:12:01.480147 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:12:01.480147 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:12:01.480147 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:12:01.480147 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:12:01.480147 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:12:01.480147 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:12:01.480147 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0aef362-32c9-463b-ba31-93ce5c561487 could not be found. Jun 24 10:12:01.480147 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:12:01.480147 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:12:01.480147 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:12:01.480147 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:12:01.480147 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:12:01.480147 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:12:01.480147 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:12:01.480147 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:12:01.480147 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:12:01.481432 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:12:01.481432 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 10:12:01.481432 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 10:12:01.481432 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 10:12:01.481432 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 10:12:01.481432 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:12:01.481432 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:12:01.481432 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:12:01.481432 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:12:01.481432 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0aef362-32c9-463b-ba31-93ce5c561487 could not be found. Jun 24 10:12:01.481432 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:12:01.481432 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:12:01.481432 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:12:01.481432 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:12:01.481432 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:12:01.481432 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:12:01.481432 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:12:01.481432 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:12:01.481432 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0aef362-32c9-463b-ba31-93ce5c561487 could not be found. Jun 24 10:12:01.481432 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:12:01.483410 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-5adffb45-95d9-4c38-8155-01ed827106f7 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Returning 404 to user: Instance f0aef362-32c9-463b-ba31-93ce5c561487 could not be found. {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:12:01.483410 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-5adffb45-95d9-4c38-8155-01ed827106f7 tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487" status: 404 len: 111 microversion: 2.1 time: 0.031314 Jun 24 10:12:01.483410 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 531/1036] 10.222.0.26 () {58 vars in 1238 bytes} [Fri Jun 24 10:12:01 2022] DELETE /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 10:12:01.490128 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-75323bd3-6326-4aed-b3f4-e0fd29c8cbdc tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:12:01.490751 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-75323bd3-6326-4aed-b3f4-e0fd29c8cbdc tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] [instance: f0aef362-32c9-463b-ba31-93ce5c561487] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:12:01.498334 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-75323bd3-6326-4aed-b3f4-e0fd29c8cbdc tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:01.498781 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-75323bd3-6326-4aed-b3f4-e0fd29c8cbdc tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:01.499557 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-75323bd3-6326-4aed-b3f4-e0fd29c8cbdc tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:01.499993 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-75323bd3-6326-4aed-b3f4-e0fd29c8cbdc tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:01.513615 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.wsgi [None req-75323bd3-6326-4aed-b3f4-e0fd29c8cbdc tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] HTTP exception thrown: Instance f0aef362-32c9-463b-ba31-93ce5c561487 could not be found. Jun 24 10:12:01.515562 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-75323bd3-6326-4aed-b3f4-e0fd29c8cbdc tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Request method failure captured: Jun 24 10:12:01.515562 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: request: GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487 HTTP/1.1 Jun 24 10:12:01.515562 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept: application/json Jun 24 10:12:01.515562 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept-Encoding: identity Jun 24 10:12:01.515562 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Connection: close Jun 24 10:12:01.515562 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Length: 0 Jun 24 10:12:01.515562 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Type: application/json Jun 24 10:12:01.515562 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Host: 10.222.0.26 Jun 24 10:12:01.515562 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Openstack-System-Scope: None Jun 24 10:12:01.515562 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: User-Agent: python-urllib3/1.26.9 Jun 24 10:12:01.515562 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Auth-Token: gAAAAABitYyzKx6mxHcouBd786V7PSRKtqG7vQygoeml9ZFRI4t-s7SskaI_N7VnM2cMTHq18lI9OepR13ZTFpIKllTjNCYBqowBTJBvubT2uG08oWBo29qBWawe6q0x1WdImPCEss3dF17N9x8N3_7uAMt0BoG5BjapetFSeerYUrODzwv3CBQ Jun 24 10:12:01.515562 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Id: None Jun 24 10:12:01.515562 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Name: None Jun 24 10:12:01.515562 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Identity-Status: Confirmed Jun 24 10:12:01.515562 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Is-Admin-Project: True Jun 24 10:12:01.515562 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Id: default Jun 24 10:12:01.515562 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Name: Default Jun 24 10:12:01.515562 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Id: 64b655c9ef0948c099f60649b9d5e78d Jun 24 10:12:01.515562 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Name: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:12:01.515562 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Role: reader,member Jun 24 10:12:01.515562 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Roles: reader,member Jun 24 10:12:01.524920 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/64b655c9ef0948c099f60649b9d5e78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_64b655c9ef0948c099f60649b9d5e78d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/64b655c9ef0948c099f60649b9d5e78d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/64b655c9ef0948c099f60649b9d5e78d"}]}] Jun 24 10:12:01.524920 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:12:01.524920 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Id: 64b655c9ef0948c099f60649b9d5e78d Jun 24 10:12:01.524920 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1676240271 Jun 24 10:12:01.524920 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User: tempest-AttachVolumeNegativeTest-1676240271-project Jun 24 10:12:01.524920 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Id: default Jun 24 10:12:01.524920 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Name: Default Jun 24 10:12:01.524920 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Id: f2c97e68f66142f9b502b215313f7e80 Jun 24 10:12:01.524920 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Name: tempest-AttachVolumeNegativeTest-1676240271-project Jun 24 10:12:01.524920 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: method: > Jun 24 10:12:01.524920 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: exception: Instance f0aef362-32c9-463b-ba31-93ce5c561487 could not be found. Jun 24 10:12:01.524920 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: action_args: {'id': 'f0aef362-32c9-463b-ba31-93ce5c561487'} Jun 24 10:12:01.527306 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:12:01.527306 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:12:01.527306 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:12:01.527306 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:12:01.527306 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:12:01.527306 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:12:01.527306 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:12:01.527306 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:12:01.527306 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:12:01.527306 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:12:01.527306 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0aef362-32c9-463b-ba31-93ce5c561487 could not be found. Jun 24 10:12:01.527306 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:12:01.527306 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:12:01.527306 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:12:01.527306 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:12:01.527306 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:12:01.527306 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:12:01.527306 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:12:01.527306 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:12:01.527306 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:12:01.530572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:12:01.530572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:12:01.530572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:12:01.530572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:12:01.530572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:12:01.530572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:12:01.530572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:12:01.530572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0aef362-32c9-463b-ba31-93ce5c561487 could not be found. Jun 24 10:12:01.530572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:12:01.530572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:12:01.530572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:12:01.530572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:12:01.530572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:12:01.530572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:12:01.530572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:12:01.530572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:12:01.530572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0aef362-32c9-463b-ba31-93ce5c561487 could not be found. Jun 24 10:12:01.530572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:12:01.532840 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-75323bd3-6326-4aed-b3f4-e0fd29c8cbdc tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] Returning 404 to user: Instance f0aef362-32c9-463b-ba31-93ce5c561487 could not be found. {{(pid=124980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:12:01.532840 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-75323bd3-6326-4aed-b3f4-e0fd29c8cbdc tempest-AttachVolumeNegativeTest-1676240271 tempest-AttachVolumeNegativeTest-1676240271-project] 10.222.0.26 "GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487" status: 404 len: 111 microversion: 2.1 time: 0.031094 Jun 24 10:12:01.532840 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 506/1037] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:12:01 2022] GET /compute/v2.1/servers/f0aef362-32c9-463b-ba31-93ce5c561487 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:12:01.868843 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-3662a182-1651-4c10-8b00-72553ae3be80 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:12:01.870401 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-3662a182-1651-4c10-8b00-72553ae3be80 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:12:01.876846 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3662a182-1651-4c10-8b00-72553ae3be80 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:01.882499 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3662a182-1651-4c10-8b00-72553ae3be80 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:01.882499 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3662a182-1651-4c10-8b00-72553ae3be80 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:01.882499 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3662a182-1651-4c10-8b00-72553ae3be80 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:01.980413 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-3662a182-1651-4c10-8b00-72553ae3be80 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:12:01.994501 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-3662a182-1651-4c10-8b00-72553ae3be80 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1139 microversion: 2.1 time: 0.129674 Jun 24 10:12:01.997263 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 532/1038] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:12:01 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1139 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:12:03.013545 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-515280ed-8bfa-470c-af79-ea16e66d10c3 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:12:03.015155 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-515280ed-8bfa-470c-af79-ea16e66d10c3 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:12:03.029839 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-515280ed-8bfa-470c-af79-ea16e66d10c3 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:03.030397 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-515280ed-8bfa-470c-af79-ea16e66d10c3 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:03.031230 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-515280ed-8bfa-470c-af79-ea16e66d10c3 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:03.031711 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-515280ed-8bfa-470c-af79-ea16e66d10c3 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:03.464247 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-515280ed-8bfa-470c-af79-ea16e66d10c3 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:12:03.473693 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-515280ed-8bfa-470c-af79-ea16e66d10c3 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1195 microversion: 2.1 time: 0.464049 Jun 24 10:12:03.484325 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 507/1039] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:12:03 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1195 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:12:04.495339 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-b02fb2ac-3606-4362-a54d-4ef94dfd7f1f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:12:04.495959 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-b02fb2ac-3606-4362-a54d-4ef94dfd7f1f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:12:04.512570 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b02fb2ac-3606-4362-a54d-4ef94dfd7f1f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:04.513701 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b02fb2ac-3606-4362-a54d-4ef94dfd7f1f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:04.514997 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b02fb2ac-3606-4362-a54d-4ef94dfd7f1f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:04.515692 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b02fb2ac-3606-4362-a54d-4ef94dfd7f1f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:04.787986 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-b02fb2ac-3606-4362-a54d-4ef94dfd7f1f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:12:04.797177 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-b02fb2ac-3606-4362-a54d-4ef94dfd7f1f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1273 microversion: 2.1 time: 0.308555 Jun 24 10:12:04.797748 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 533/1040] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:12:04 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1273 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:12:05.815847 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-4b3ae2a2-e511-43d6-bf60-2ddb247e1695 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:12:05.817119 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-4b3ae2a2-e511-43d6-bf60-2ddb247e1695 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:12:05.825958 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4b3ae2a2-e511-43d6-bf60-2ddb247e1695 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:05.826428 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4b3ae2a2-e511-43d6-bf60-2ddb247e1695 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:05.827420 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4b3ae2a2-e511-43d6-bf60-2ddb247e1695 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:05.827874 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-4b3ae2a2-e511-43d6-bf60-2ddb247e1695 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:06.059515 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-634b74b8-18f3-4063-954e-b2e159e5ffe4 req-b670a9f8-d0bc-4917-8346-36200d555540 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82a43dc1-7e32-45bd-a007-1f9eb0fcedb3", "tag": "27d385ce-eca4-4188-828a-5f898681a1fe"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:12:06.077596 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-634b74b8-18f3-4063-954e-b2e159e5ffe4 req-b670a9f8-d0bc-4917-8346-36200d555540 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:06.078085 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-634b74b8-18f3-4063-954e-b2e159e5ffe4 req-b670a9f8-d0bc-4917-8346-36200d555540 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:06.091241 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:12:06.106569 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-634b74b8-18f3-4063-954e-b2e159e5ffe4 req-b670a9f8-d0bc-4917-8346-36200d555540 service nova] Creating event network-changed:27d385ce-eca4-4188-828a-5f898681a1fe for instance 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 on hv-cinder-84327 Jun 24 10:12:06.116432 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-4b3ae2a2-e511-43d6-bf60-2ddb247e1695 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:12:06.121638 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-634b74b8-18f3-4063-954e-b2e159e5ffe4 req-b670a9f8-d0bc-4917-8346-36200d555540 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065887 Jun 24 10:12:06.124154 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 534/1041] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:12:06.145687 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-4b3ae2a2-e511-43d6-bf60-2ddb247e1695 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1261 microversion: 2.1 time: 0.334397 Jun 24 10:12:06.146424 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 508/1042] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:12:05 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1261 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:12:07.173908 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-74c8016a-10f1-47dc-95c7-37c33162815b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:12:07.174772 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-74c8016a-10f1-47dc-95c7-37c33162815b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:12:07.182309 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-74c8016a-10f1-47dc-95c7-37c33162815b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:07.182756 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-74c8016a-10f1-47dc-95c7-37c33162815b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:07.183533 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-74c8016a-10f1-47dc-95c7-37c33162815b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:07.183972 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-74c8016a-10f1-47dc-95c7-37c33162815b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:07.331074 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-74c8016a-10f1-47dc-95c7-37c33162815b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:12:07.338939 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-74c8016a-10f1-47dc-95c7-37c33162815b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1261 microversion: 2.1 time: 0.170529 Jun 24 10:12:07.339519 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 535/1043] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:12:07 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1261 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:12:08.361242 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-9b192ed2-c114-4ced-9ed4-f6f3f0863cb5 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:12:08.361242 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-9b192ed2-c114-4ced-9ed4-f6f3f0863cb5 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:12:08.367966 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9b192ed2-c114-4ced-9ed4-f6f3f0863cb5 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:08.367966 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9b192ed2-c114-4ced-9ed4-f6f3f0863cb5 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:08.369897 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9b192ed2-c114-4ced-9ed4-f6f3f0863cb5 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:08.369897 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9b192ed2-c114-4ced-9ed4-f6f3f0863cb5 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:08.552395 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-9b192ed2-c114-4ced-9ed4-f6f3f0863cb5 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:12:08.560146 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-9b192ed2-c114-4ced-9ed4-f6f3f0863cb5 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1261 microversion: 2.1 time: 0.207258 Jun 24 10:12:08.561333 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 509/1044] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:12:08 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1261 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:12:09.580491 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-c6f3c042-e827-48bb-bfb1-205c2a923362 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:12:09.581291 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-c6f3c042-e827-48bb-bfb1-205c2a923362 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:12:09.588608 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c6f3c042-e827-48bb-bfb1-205c2a923362 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:09.589059 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c6f3c042-e827-48bb-bfb1-205c2a923362 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:09.589835 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c6f3c042-e827-48bb-bfb1-205c2a923362 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:09.590451 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-c6f3c042-e827-48bb-bfb1-205c2a923362 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:09.769338 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell0:SELECT=2 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:12:09.789973 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-c6f3c042-e827-48bb-bfb1-205c2a923362 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:12:09.797736 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-c6f3c042-e827-48bb-bfb1-205c2a923362 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1261 microversion: 2.1 time: 0.223649 Jun 24 10:12:09.798308 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 536/1045] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:12:09 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1261 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:12:10.815046 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-5de14c56-0e24-4c94-95a9-000a42c07d66 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:12:10.815617 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-5de14c56-0e24-4c94-95a9-000a42c07d66 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:12:10.817676 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell0:SELECT=2 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:12:10.823465 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5de14c56-0e24-4c94-95a9-000a42c07d66 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:10.823918 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5de14c56-0e24-4c94-95a9-000a42c07d66 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:10.824885 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5de14c56-0e24-4c94-95a9-000a42c07d66 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:10.825334 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5de14c56-0e24-4c94-95a9-000a42c07d66 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:10.848054 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell0:SELECT=8 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:12:11.002582 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-5de14c56-0e24-4c94-95a9-000a42c07d66 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:12:11.011138 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-5de14c56-0e24-4c94-95a9-000a42c07d66 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1261 microversion: 2.1 time: 0.200803 Jun 24 10:12:11.011703 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 510/1046] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:12:10 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1261 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:12:12.028519 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-d49eda64-69f1-4cea-8801-843dbbad021a tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:12:12.029141 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-d49eda64-69f1-4cea-8801-843dbbad021a tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:12:12.036860 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d49eda64-69f1-4cea-8801-843dbbad021a tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:12.037313 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d49eda64-69f1-4cea-8801-843dbbad021a tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:12.045132 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d49eda64-69f1-4cea-8801-843dbbad021a tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:12.045132 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d49eda64-69f1-4cea-8801-843dbbad021a tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:12.180920 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d49eda64-69f1-4cea-8801-843dbbad021a tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:12:12.189253 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-d49eda64-69f1-4cea-8801-843dbbad021a tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1261 microversion: 2.1 time: 0.164955 Jun 24 10:12:12.189967 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 537/1047] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:12:12 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:12:13.206858 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-888afbce-f607-47c4-b997-3cab46e3b983 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:12:13.207447 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-888afbce-f607-47c4-b997-3cab46e3b983 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:12:13.214342 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-888afbce-f607-47c4-b997-3cab46e3b983 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:13.214798 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-888afbce-f607-47c4-b997-3cab46e3b983 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:13.215574 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-888afbce-f607-47c4-b997-3cab46e3b983 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:13.216058 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-888afbce-f607-47c4-b997-3cab46e3b983 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:13.368256 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-888afbce-f607-47c4-b997-3cab46e3b983 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:12:13.377453 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-888afbce-f607-47c4-b997-3cab46e3b983 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1261 microversion: 2.1 time: 0.174930 Jun 24 10:12:13.378580 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 511/1048] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:12:13 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1261 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:12:14.395530 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-0e03867e-d5c1-4f04-a314-54710507d0b5 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:12:14.396337 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-0e03867e-d5c1-4f04-a314-54710507d0b5 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:12:14.403237 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0e03867e-d5c1-4f04-a314-54710507d0b5 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:14.403691 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0e03867e-d5c1-4f04-a314-54710507d0b5 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:14.404505 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0e03867e-d5c1-4f04-a314-54710507d0b5 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:14.404937 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0e03867e-d5c1-4f04-a314-54710507d0b5 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:14.554248 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-0e03867e-d5c1-4f04-a314-54710507d0b5 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:12:14.567326 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-0e03867e-d5c1-4f04-a314-54710507d0b5 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1261 microversion: 2.1 time: 0.175425 Jun 24 10:12:14.578257 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 538/1049] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:12:14 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1261 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:12:15.591933 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-d3159231-074d-42d4-8b71-f1b5637ed304 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:12:15.594352 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-d3159231-074d-42d4-8b71-f1b5637ed304 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:12:15.603636 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d3159231-074d-42d4-8b71-f1b5637ed304 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:15.604528 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d3159231-074d-42d4-8b71-f1b5637ed304 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:15.605617 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d3159231-074d-42d4-8b71-f1b5637ed304 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:15.606197 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d3159231-074d-42d4-8b71-f1b5637ed304 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:15.778540 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d3159231-074d-42d4-8b71-f1b5637ed304 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:12:15.787613 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-d3159231-074d-42d4-8b71-f1b5637ed304 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1261 microversion: 2.1 time: 0.201829 Jun 24 10:12:15.788143 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 512/1050] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:12:15 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1261 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:12:16.805359 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-9a17bbd6-2a0f-46df-9207-4781afe65201 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:12:16.805958 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-9a17bbd6-2a0f-46df-9207-4781afe65201 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:12:16.813693 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9a17bbd6-2a0f-46df-9207-4781afe65201 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:16.814158 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9a17bbd6-2a0f-46df-9207-4781afe65201 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:16.814936 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9a17bbd6-2a0f-46df-9207-4781afe65201 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:16.815380 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9a17bbd6-2a0f-46df-9207-4781afe65201 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:16.998599 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-9a17bbd6-2a0f-46df-9207-4781afe65201 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:12:17.010777 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-9a17bbd6-2a0f-46df-9207-4781afe65201 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1261 microversion: 2.1 time: 0.209679 Jun 24 10:12:17.012264 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 539/1051] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:12:16 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1261 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:12:17.446671 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-e5d55791-5111-47b5-8ccd-cc8ea90a1a31 req-a5fe01c2-310b-4bdf-a308-00a5b2715560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a43dc1-7e32-45bd-a007-1f9eb0fcedb3", "name": "network-vif-plugged", "status": "completed", "tag": "27d385ce-eca4-4188-828a-5f898681a1fe"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:12:17.470638 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-e5d55791-5111-47b5-8ccd-cc8ea90a1a31 req-a5fe01c2-310b-4bdf-a308-00a5b2715560 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:17.471256 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-e5d55791-5111-47b5-8ccd-cc8ea90a1a31 req-a5fe01c2-310b-4bdf-a308-00a5b2715560 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:17.491166 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-e5d55791-5111-47b5-8ccd-cc8ea90a1a31 req-a5fe01c2-310b-4bdf-a308-00a5b2715560 service nova] Creating event network-vif-plugged:27d385ce-eca4-4188-828a-5f898681a1fe for instance 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 on hv-cinder-84327 Jun 24 10:12:17.501608 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-e5d55791-5111-47b5-8ccd-cc8ea90a1a31 req-a5fe01c2-310b-4bdf-a308-00a5b2715560 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239941 Jun 24 10:12:17.502569 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 513/1052] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:12:18.029131 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-75ce623a-d2e9-4537-946c-2e86ae55ef1f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:12:18.031030 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-75ce623a-d2e9-4537-946c-2e86ae55ef1f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:12:18.038475 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-75ce623a-d2e9-4537-946c-2e86ae55ef1f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:18.039276 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-75ce623a-d2e9-4537-946c-2e86ae55ef1f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:18.040346 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-75ce623a-d2e9-4537-946c-2e86ae55ef1f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:18.040979 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-75ce623a-d2e9-4537-946c-2e86ae55ef1f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:18.231994 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-75ce623a-d2e9-4537-946c-2e86ae55ef1f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:12:18.239985 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-75ce623a-d2e9-4537-946c-2e86ae55ef1f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1261 microversion: 2.1 time: 0.215069 Jun 24 10:12:18.240793 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 540/1053] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:12:18 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1261 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:12:19.257961 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-abef3a51-2933-4a18-83bc-2c107b05b77f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:12:19.258748 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-abef3a51-2933-4a18-83bc-2c107b05b77f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:12:19.260812 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:12:19.266802 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-abef3a51-2933-4a18-83bc-2c107b05b77f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:19.267252 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-abef3a51-2933-4a18-83bc-2c107b05b77f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:19.268020 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-abef3a51-2933-4a18-83bc-2c107b05b77f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:19.268489 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-abef3a51-2933-4a18-83bc-2c107b05b77f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:19.419724 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-abef3a51-2933-4a18-83bc-2c107b05b77f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:12:19.427531 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-abef3a51-2933-4a18-83bc-2c107b05b77f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1261 microversion: 2.1 time: 0.174209 Jun 24 10:12:19.428388 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 514/1054] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:12:19 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1261 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:12:20.447165 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-4ed66911-6b95-459b-815e-f44039280ddb tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:12:20.448051 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-4ed66911-6b95-459b-815e-f44039280ddb tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:12:20.454707 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4ed66911-6b95-459b-815e-f44039280ddb tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:20.460546 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4ed66911-6b95-459b-815e-f44039280ddb tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:20.460546 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4ed66911-6b95-459b-815e-f44039280ddb tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:20.460546 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4ed66911-6b95-459b-815e-f44039280ddb tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:20.601102 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-4ed66911-6b95-459b-815e-f44039280ddb tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:12:20.608783 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-4ed66911-6b95-459b-815e-f44039280ddb tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1445 microversion: 2.1 time: 0.166669 Jun 24 10:12:20.609371 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 541/1055] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:12:20 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1445 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:12:20.638423 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-9d426d8d-1d47-4e3e-b348-b9c6e342cb23 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:12:20.639148 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-9d426d8d-1d47-4e3e-b348-b9c6e342cb23 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:12:20.646334 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9d426d8d-1d47-4e3e-b348-b9c6e342cb23 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:20.646797 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9d426d8d-1d47-4e3e-b348-b9c6e342cb23 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:20.647748 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9d426d8d-1d47-4e3e-b348-b9c6e342cb23 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:20.648199 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9d426d8d-1d47-4e3e-b348-b9c6e342cb23 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:20.671006 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:12:20.803350 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-9d426d8d-1d47-4e3e-b348-b9c6e342cb23 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:12:20.811918 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-9d426d8d-1d47-4e3e-b348-b9c6e342cb23 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1445 microversion: 2.1 time: 0.178047 Jun 24 10:12:20.812525 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 515/1056] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:12:20 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1445 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:12:23.734703 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-a2438e24-3f3c-42a6-ab2a-404ed2792927 req-81171602-ca51-4bb9-b7b3-f4a227e1eebe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82a43dc1-7e32-45bd-a007-1f9eb0fcedb3", "tag": "27d385ce-eca4-4188-828a-5f898681a1fe"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:12:23.741228 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:12:23.751888 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-a2438e24-3f3c-42a6-ab2a-404ed2792927 req-81171602-ca51-4bb9-b7b3-f4a227e1eebe service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:12:23.752841 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-a2438e24-3f3c-42a6-ab2a-404ed2792927 req-81171602-ca51-4bb9-b7b3-f4a227e1eebe service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:12:23.769677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-a2438e24-3f3c-42a6-ab2a-404ed2792927 req-81171602-ca51-4bb9-b7b3-f4a227e1eebe service nova] Creating event network-changed:27d385ce-eca4-4188-828a-5f898681a1fe for instance 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 on hv-cinder-84327 Jun 24 10:12:23.775584 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-a2438e24-3f3c-42a6-ab2a-404ed2792927 req-81171602-ca51-4bb9-b7b3-f4a227e1eebe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.250040 Jun 24 10:12:23.778690 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 542/1057] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:12:56.623269 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:12:56.623983 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Fri Jun 24 10:12:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:13:26.402437 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-62f88e5a-ab56-489f-ac92-ca5ed062150a tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Action: 'create', calling method: .version_select at 0x7f03098ec700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1794596080", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcWxZnB9YYT2j4ZBhFlDtsTv8YuBP33+jkL39mAtbjPgSbcJzT/tZllkufPsB+UCfkleD+xo5prBQvt/NPzSSCSiz6cDoieV1sm6bifeoF5RziCXMpomgqhoGVYp/k34w=="}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:13:26.417332 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-62f88e5a-ab56-489f-ac92-ca5ed062150a tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Getting quotas for project 2ea76e34ae2a4569851abd4e596b5e77. Resources: {'key_pairs'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:13:26.421155 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-62f88e5a-ab56-489f-ac92-ca5ed062150a tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Getting quotas for user 40db8a50905141ffb83d84d83065952b and project 2ea76e34ae2a4569851abd4e596b5e77. Resources: {'key_pairs'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:13:26.524113 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-62f88e5a-ab56-489f-ac92-ca5ed062150a tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.349236 Jun 24 10:13:26.524753 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 516/1058] 10.222.0.26 () {60 vars in 1158 bytes} [Fri Jun 24 10:13:26 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:13:46.733258 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc8eaeca-9dd9-49de-aab8-85c5b9acfbec] AMQP server on 10.222.0.26:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 24 10:13:46.733895 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=45 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:13:46.738694 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-e115ef00-3fc8-414a-8d92-02693955c31e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-177403628", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1794596080", "security_groups": [{"name": "tempest-secgroup-smoke-1633595985"}], "block_device_mapping_v2": [{"uuid": "e0aed391-3459-425d-a115-213605c13277", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7e0493cf-9922-46cd-9f38-42fd8c5fc022"}]}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:13:46.859409 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.network.neutron [None req-e115ef00-3fc8-414a-8d92-02693955c31e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] validate_networks() for [('7e0493cf-9922-46cd-9f38-42fd8c5fc022', None, None, None, None, None)] {{(pid=124979) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:13:47.414842 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-e115ef00-3fc8-414a-8d92-02693955c31e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Flavor limits 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:13:47.415262 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-e115ef00-3fc8-414a-8d92-02693955c31e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Image limits 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:13:47.416354 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-e115ef00-3fc8-414a-8d92-02693955c31e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Flavor pref 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:13:47.416768 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-e115ef00-3fc8-414a-8d92-02693955c31e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Image pref 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:13:47.417180 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-e115ef00-3fc8-414a-8d92-02693955c31e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:13:47.426306 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e115ef00-3fc8-414a-8d92-02693955c31e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:13:47.426756 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e115ef00-3fc8-414a-8d92-02693955c31e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:13:47.427566 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e115ef00-3fc8-414a-8d92-02693955c31e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:13:47.427998 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e115ef00-3fc8-414a-8d92-02693955c31e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:13:47.445829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-e115ef00-3fc8-414a-8d92-02693955c31e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Getting quotas for project 2ea76e34ae2a4569851abd4e596b5e77. Resources: {'instances', 'cores', 'ram'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:13:47.450061 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-e115ef00-3fc8-414a-8d92-02693955c31e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Getting quotas for user 40db8a50905141ffb83d84d83065952b and project 2ea76e34ae2a4569851abd4e596b5e77. Resources: {'instances', 'cores', 'ram'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:13:47.515470 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-e115ef00-3fc8-414a-8d92-02693955c31e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Going to run 1 instances... {{(pid=124979) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:13:47.517733 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-e115ef00-3fc8-414a-8d92-02693955c31e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 40064e94-9dd9-4008-a3f1-2216553f98ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e0aed391-3459-425d-a115-213605c13277',volume_size=None,volume_type=None)] {{(pid=124979) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:13:47.740964 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc8eaeca-9dd9-49de-aab8-85c5b9acfbec] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 49054. Jun 24 10:13:48.163985 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-e115ef00-3fc8-414a-8d92-02693955c31e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.434657 Jun 24 10:13:48.164663 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 543/1059] 10.222.0.26 () {60 vars in 1146 bytes} [Fri Jun 24 10:13:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 1436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:13:48.175701 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-98f65dd9-f137-44cb-ba23-38be345d651f tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:13:48.177023 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-98f65dd9-f137-44cb-ba23-38be345d651f tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 40064e94-9dd9-4008-a3f1-2216553f98ea] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:13:48.178644 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=5 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:13:48.179429 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell0:SELECT=4 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:13:48.179918 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:13:48.235307 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-98f65dd9-f137-44cb-ba23-38be345d651f tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:13:48.244395 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-98f65dd9-f137-44cb-ba23-38be345d651f tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea" status: 200 len: 1094 microversion: 2.1 time: 0.072255 Jun 24 10:13:48.245017 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 517/1060] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:13:48 2022] GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:13:49.264961 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-872d6f39-c00c-408e-a85c-4af667e9aeff tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:13:49.264961 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-872d6f39-c00c-408e-a85c-4af667e9aeff tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 40064e94-9dd9-4008-a3f1-2216553f98ea] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:13:49.318721 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-872d6f39-c00c-408e-a85c-4af667e9aeff tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:13:49.326380 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-872d6f39-c00c-408e-a85c-4af667e9aeff tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea" status: 200 len: 1094 microversion: 2.1 time: 0.068547 Jun 24 10:13:49.327145 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 544/1061] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:13:49 2022] GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:13:50.344732 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-ff9e12ba-9a4b-4d5e-8dd7-875b283829d0 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:13:50.345464 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-ff9e12ba-9a4b-4d5e-8dd7-875b283829d0 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 40064e94-9dd9-4008-a3f1-2216553f98ea] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:13:50.354170 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ff9e12ba-9a4b-4d5e-8dd7-875b283829d0 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:13:50.354630 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ff9e12ba-9a4b-4d5e-8dd7-875b283829d0 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:13:50.355407 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ff9e12ba-9a4b-4d5e-8dd7-875b283829d0 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:13:50.355845 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-ff9e12ba-9a4b-4d5e-8dd7-875b283829d0 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:13:50.422117 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-ff9e12ba-9a4b-4d5e-8dd7-875b283829d0 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:13:50.430589 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-ff9e12ba-9a4b-4d5e-8dd7-875b283829d0 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea" status: 200 len: 1192 microversion: 2.1 time: 0.090431 Jun 24 10:13:50.431215 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 518/1062] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:13:50 2022] GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea => generated 1192 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:13:51.448554 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-028820ec-c184-431e-adcb-eebd4d017aa3 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:13:51.449122 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-028820ec-c184-431e-adcb-eebd4d017aa3 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 40064e94-9dd9-4008-a3f1-2216553f98ea] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:13:51.456655 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-028820ec-c184-431e-adcb-eebd4d017aa3 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:13:51.457097 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-028820ec-c184-431e-adcb-eebd4d017aa3 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:13:51.457869 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-028820ec-c184-431e-adcb-eebd4d017aa3 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:13:51.458297 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-028820ec-c184-431e-adcb-eebd4d017aa3 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:13:51.536411 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-028820ec-c184-431e-adcb-eebd4d017aa3 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:13:51.545053 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-028820ec-c184-431e-adcb-eebd4d017aa3 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea" status: 200 len: 1210 microversion: 2.1 time: 0.100593 Jun 24 10:13:51.550407 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 545/1063] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:13:51 2022] GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea => generated 1210 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:13:52.563608 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-6d15dfdd-469e-40c6-b419-eedfd7bf9bfd tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:13:52.564691 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-6d15dfdd-469e-40c6-b419-eedfd7bf9bfd tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 40064e94-9dd9-4008-a3f1-2216553f98ea] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:13:52.572511 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6d15dfdd-469e-40c6-b419-eedfd7bf9bfd tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:13:52.583653 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6d15dfdd-469e-40c6-b419-eedfd7bf9bfd tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:13:52.583653 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6d15dfdd-469e-40c6-b419-eedfd7bf9bfd tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:13:52.583653 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6d15dfdd-469e-40c6-b419-eedfd7bf9bfd tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:13:52.732069 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-6d15dfdd-469e-40c6-b419-eedfd7bf9bfd tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:13:52.740951 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-6d15dfdd-469e-40c6-b419-eedfd7bf9bfd tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea" status: 200 len: 1278 microversion: 2.1 time: 0.181748 Jun 24 10:13:52.741529 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 519/1064] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:13:52 2022] GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea => generated 1278 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:13:53.131158 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-55d40edd-e14f-403e-9245-fe2470c27c8b req-0f12a1c6-c798-4e4f-8827-4561a2aa773b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40064e94-9dd9-4008-a3f1-2216553f98ea", "tag": "6e3e55b4-6466-411b-bd31-f471d4be88fe"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:13:53.145489 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-55d40edd-e14f-403e-9245-fe2470c27c8b req-0f12a1c6-c798-4e4f-8827-4561a2aa773b service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:13:53.146266 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-55d40edd-e14f-403e-9245-fe2470c27c8b req-0f12a1c6-c798-4e4f-8827-4561a2aa773b service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:13:53.159919 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-55d40edd-e14f-403e-9245-fe2470c27c8b req-0f12a1c6-c798-4e4f-8827-4561a2aa773b service nova] Creating event network-changed:6e3e55b4-6466-411b-bd31-f471d4be88fe for instance 40064e94-9dd9-4008-a3f1-2216553f98ea on hv-cinder-84327 Jun 24 10:13:53.165725 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-55d40edd-e14f-403e-9245-fe2470c27c8b req-0f12a1c6-c798-4e4f-8827-4561a2aa773b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044912 Jun 24 10:13:53.174425 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 546/1065] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:13:53.765385 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-12c2263e-dac2-485a-8d10-23c9855ccfd6 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:13:53.771733 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-12c2263e-dac2-485a-8d10-23c9855ccfd6 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 40064e94-9dd9-4008-a3f1-2216553f98ea] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:13:53.778443 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-12c2263e-dac2-485a-8d10-23c9855ccfd6 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:13:53.779205 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-12c2263e-dac2-485a-8d10-23c9855ccfd6 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:13:53.780472 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-12c2263e-dac2-485a-8d10-23c9855ccfd6 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:13:53.781259 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-12c2263e-dac2-485a-8d10-23c9855ccfd6 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:13:54.030954 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-12c2263e-dac2-485a-8d10-23c9855ccfd6 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:13:54.040650 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-12c2263e-dac2-485a-8d10-23c9855ccfd6 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea" status: 200 len: 1266 microversion: 2.1 time: 0.282086 Jun 24 10:13:54.041252 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 520/1066] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:13:53 2022] GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea => generated 1266 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:13:55.059678 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-3fe8182e-a7e4-40de-a228-00ce9a096c06 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:13:55.060413 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-3fe8182e-a7e4-40de-a228-00ce9a096c06 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 40064e94-9dd9-4008-a3f1-2216553f98ea] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:13:55.067130 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3fe8182e-a7e4-40de-a228-00ce9a096c06 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:13:55.067577 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3fe8182e-a7e4-40de-a228-00ce9a096c06 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:13:55.068571 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3fe8182e-a7e4-40de-a228-00ce9a096c06 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:13:55.068865 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3fe8182e-a7e4-40de-a228-00ce9a096c06 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:13:55.216007 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-3fe8182e-a7e4-40de-a228-00ce9a096c06 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:13:55.225576 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-3fe8182e-a7e4-40de-a228-00ce9a096c06 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea" status: 200 len: 1266 microversion: 2.1 time: 0.170650 Jun 24 10:13:55.227842 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 547/1067] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:13:55 2022] GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:13:56.244474 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-e00c1ebc-3bf8-4d3f-bbb8-e62f162c2f89 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:13:56.245368 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-e00c1ebc-3bf8-4d3f-bbb8-e62f162c2f89 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 40064e94-9dd9-4008-a3f1-2216553f98ea] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:13:56.251781 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e00c1ebc-3bf8-4d3f-bbb8-e62f162c2f89 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:13:56.252265 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e00c1ebc-3bf8-4d3f-bbb8-e62f162c2f89 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:13:56.253070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e00c1ebc-3bf8-4d3f-bbb8-e62f162c2f89 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:13:56.253510 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e00c1ebc-3bf8-4d3f-bbb8-e62f162c2f89 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:13:56.417328 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-e00c1ebc-3bf8-4d3f-bbb8-e62f162c2f89 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:13:56.427711 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-e00c1ebc-3bf8-4d3f-bbb8-e62f162c2f89 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea" status: 200 len: 1266 microversion: 2.1 time: 0.187953 Jun 24 10:13:56.428673 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 521/1068] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:13:56 2022] GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:13:57.445835 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-4508dfce-9934-408d-ae2b-4300fc496d69 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:13:57.447139 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-4508dfce-9934-408d-ae2b-4300fc496d69 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 40064e94-9dd9-4008-a3f1-2216553f98ea] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:13:57.449651 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell0:SELECT=2 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:13:57.454989 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4508dfce-9934-408d-ae2b-4300fc496d69 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:13:57.455446 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4508dfce-9934-408d-ae2b-4300fc496d69 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:13:57.456256 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4508dfce-9934-408d-ae2b-4300fc496d69 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:13:57.456818 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-4508dfce-9934-408d-ae2b-4300fc496d69 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:13:57.599032 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-4508dfce-9934-408d-ae2b-4300fc496d69 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:13:57.607076 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-4508dfce-9934-408d-ae2b-4300fc496d69 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea" status: 200 len: 1266 microversion: 2.1 time: 0.165191 Jun 24 10:13:57.607654 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 548/1069] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:13:57 2022] GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:13:58.625689 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-6a66b15a-9f98-4bb5-ac45-e98aaa8e4d58 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:13:58.626310 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-6a66b15a-9f98-4bb5-ac45-e98aaa8e4d58 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 40064e94-9dd9-4008-a3f1-2216553f98ea] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:13:58.633120 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6a66b15a-9f98-4bb5-ac45-e98aaa8e4d58 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:13:58.633573 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6a66b15a-9f98-4bb5-ac45-e98aaa8e4d58 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:13:58.634332 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6a66b15a-9f98-4bb5-ac45-e98aaa8e4d58 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:13:58.634767 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6a66b15a-9f98-4bb5-ac45-e98aaa8e4d58 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:13:58.781915 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-6a66b15a-9f98-4bb5-ac45-e98aaa8e4d58 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:13:58.792917 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-6a66b15a-9f98-4bb5-ac45-e98aaa8e4d58 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea" status: 200 len: 1266 microversion: 2.1 time: 0.171198 Jun 24 10:13:58.793488 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 522/1070] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:13:58 2022] GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:13:59.810980 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-d4fdc581-788a-4e1f-a418-81f324bc9826 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:13:59.811708 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-d4fdc581-788a-4e1f-a418-81f324bc9826 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 40064e94-9dd9-4008-a3f1-2216553f98ea] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:13:59.814117 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell0:SELECT=8 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:13:59.820007 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d4fdc581-788a-4e1f-a418-81f324bc9826 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:13:59.820622 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d4fdc581-788a-4e1f-a418-81f324bc9826 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:13:59.821607 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d4fdc581-788a-4e1f-a418-81f324bc9826 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:13:59.822137 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d4fdc581-788a-4e1f-a418-81f324bc9826 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:13:59.972374 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d4fdc581-788a-4e1f-a418-81f324bc9826 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:13:59.980835 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-d4fdc581-788a-4e1f-a418-81f324bc9826 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea" status: 200 len: 1266 microversion: 2.1 time: 0.173860 Jun 24 10:13:59.981421 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 549/1071] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:13:59 2022] GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:01.000821 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-54b1748c-9aa4-45fa-a0dd-dd076b467a9d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:01.001402 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-54b1748c-9aa4-45fa-a0dd-dd076b467a9d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 40064e94-9dd9-4008-a3f1-2216553f98ea] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:01.003707 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell0:SELECT=2 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:14:01.009528 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-54b1748c-9aa4-45fa-a0dd-dd076b467a9d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:01.009996 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-54b1748c-9aa4-45fa-a0dd-dd076b467a9d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:01.010796 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-54b1748c-9aa4-45fa-a0dd-dd076b467a9d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:01.011234 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-54b1748c-9aa4-45fa-a0dd-dd076b467a9d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:01.172552 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-54b1748c-9aa4-45fa-a0dd-dd076b467a9d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:01.181269 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-54b1748c-9aa4-45fa-a0dd-dd076b467a9d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea" status: 200 len: 1266 microversion: 2.1 time: 0.184013 Jun 24 10:14:01.181856 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 523/1072] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:00 2022] GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:02.198908 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-97ae5f1a-593a-4de7-9411-8bc3a91aca5d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:02.200193 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-97ae5f1a-593a-4de7-9411-8bc3a91aca5d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 40064e94-9dd9-4008-a3f1-2216553f98ea] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:02.207758 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-97ae5f1a-593a-4de7-9411-8bc3a91aca5d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:02.213199 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-97ae5f1a-593a-4de7-9411-8bc3a91aca5d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:02.213199 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-97ae5f1a-593a-4de7-9411-8bc3a91aca5d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:02.213199 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-97ae5f1a-593a-4de7-9411-8bc3a91aca5d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:02.359968 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-97ae5f1a-593a-4de7-9411-8bc3a91aca5d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:02.368025 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-97ae5f1a-593a-4de7-9411-8bc3a91aca5d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea" status: 200 len: 1266 microversion: 2.1 time: 0.173591 Jun 24 10:14:02.368814 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 550/1073] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:02 2022] GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:03.385419 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-35095afb-a6dd-48aa-88d8-01a3b7b1250c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:03.386040 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-35095afb-a6dd-48aa-88d8-01a3b7b1250c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 40064e94-9dd9-4008-a3f1-2216553f98ea] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:03.392644 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-35095afb-a6dd-48aa-88d8-01a3b7b1250c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:03.393098 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-35095afb-a6dd-48aa-88d8-01a3b7b1250c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:03.393916 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-35095afb-a6dd-48aa-88d8-01a3b7b1250c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:03.394364 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-35095afb-a6dd-48aa-88d8-01a3b7b1250c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:03.538518 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-35095afb-a6dd-48aa-88d8-01a3b7b1250c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:03.546813 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-35095afb-a6dd-48aa-88d8-01a3b7b1250c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea" status: 200 len: 1266 microversion: 2.1 time: 0.165275 Jun 24 10:14:03.547379 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 524/1074] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:03 2022] GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:03.772787 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-8eef3a66-233b-4c92-b201-fad63d6b6f56 req-c9db22e7-be9f-4bbe-9181-f967f057d06d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40064e94-9dd9-4008-a3f1-2216553f98ea", "name": "network-vif-plugged", "status": "completed", "tag": "6e3e55b4-6466-411b-bd31-f471d4be88fe"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:14:03.782577 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-8eef3a66-233b-4c92-b201-fad63d6b6f56 req-c9db22e7-be9f-4bbe-9181-f967f057d06d service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:03.783020 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-8eef3a66-233b-4c92-b201-fad63d6b6f56 req-c9db22e7-be9f-4bbe-9181-f967f057d06d service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:03.793970 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-8eef3a66-233b-4c92-b201-fad63d6b6f56 req-c9db22e7-be9f-4bbe-9181-f967f057d06d service nova] Creating event network-vif-plugged:6e3e55b4-6466-411b-bd31-f471d4be88fe for instance 40064e94-9dd9-4008-a3f1-2216553f98ea on hv-cinder-84327 Jun 24 10:14:03.799031 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-8eef3a66-233b-4c92-b201-fad63d6b6f56 req-c9db22e7-be9f-4bbe-9181-f967f057d06d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030412 Jun 24 10:14:03.799607 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 551/1075] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:14:04.564222 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-9c345e6d-7f06-4cb6-9d3c-17675ef3ffe9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:04.564868 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-9c345e6d-7f06-4cb6-9d3c-17675ef3ffe9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 40064e94-9dd9-4008-a3f1-2216553f98ea] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:04.571978 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9c345e6d-7f06-4cb6-9d3c-17675ef3ffe9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:04.572460 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9c345e6d-7f06-4cb6-9d3c-17675ef3ffe9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:04.573233 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9c345e6d-7f06-4cb6-9d3c-17675ef3ffe9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:04.573674 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9c345e6d-7f06-4cb6-9d3c-17675ef3ffe9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:04.712273 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-9c345e6d-7f06-4cb6-9d3c-17675ef3ffe9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:04.720149 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-9c345e6d-7f06-4cb6-9d3c-17675ef3ffe9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea" status: 200 len: 1266 microversion: 2.1 time: 0.159808 Jun 24 10:14:04.720735 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 525/1076] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:04 2022] GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:05.738538 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-98d5a871-4610-46e6-8458-cc7489c5712d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:05.739233 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-98d5a871-4610-46e6-8458-cc7489c5712d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 40064e94-9dd9-4008-a3f1-2216553f98ea] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:05.746349 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-98d5a871-4610-46e6-8458-cc7489c5712d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:05.746793 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-98d5a871-4610-46e6-8458-cc7489c5712d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:05.747557 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-98d5a871-4610-46e6-8458-cc7489c5712d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:05.748137 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-98d5a871-4610-46e6-8458-cc7489c5712d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:05.889023 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-98d5a871-4610-46e6-8458-cc7489c5712d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:05.897322 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-98d5a871-4610-46e6-8458-cc7489c5712d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea" status: 200 len: 1452 microversion: 2.1 time: 0.163629 Jun 24 10:14:05.899775 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 552/1077] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:05 2022] GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:05.913569 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-f7a5a8b1-44b4-43f9-a501-de2bbbc47a45 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:05.914194 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-f7a5a8b1-44b4-43f9-a501-de2bbbc47a45 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 40064e94-9dd9-4008-a3f1-2216553f98ea] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:05.921727 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f7a5a8b1-44b4-43f9-a501-de2bbbc47a45 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:05.922188 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f7a5a8b1-44b4-43f9-a501-de2bbbc47a45 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:05.922999 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f7a5a8b1-44b4-43f9-a501-de2bbbc47a45 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:05.923442 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f7a5a8b1-44b4-43f9-a501-de2bbbc47a45 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:06.065274 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-f7a5a8b1-44b4-43f9-a501-de2bbbc47a45 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:06.073567 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-f7a5a8b1-44b4-43f9-a501-de2bbbc47a45 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea" status: 200 len: 1452 microversion: 2.1 time: 0.163857 Jun 24 10:14:06.074151 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 526/1078] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:05 2022] GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:08.723121 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-26764f90-af2b-4067-9e11-6114d74b14d0 req-f1820ad3-7543-4583-b722-b8712e68cb05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40064e94-9dd9-4008-a3f1-2216553f98ea", "tag": "6e3e55b4-6466-411b-bd31-f471d4be88fe"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:14:08.732899 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-26764f90-af2b-4067-9e11-6114d74b14d0 req-f1820ad3-7543-4583-b722-b8712e68cb05 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:08.733350 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-26764f90-af2b-4067-9e11-6114d74b14d0 req-f1820ad3-7543-4583-b722-b8712e68cb05 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:08.745571 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-26764f90-af2b-4067-9e11-6114d74b14d0 req-f1820ad3-7543-4583-b722-b8712e68cb05 service nova] Creating event network-changed:6e3e55b4-6466-411b-bd31-f471d4be88fe for instance 40064e94-9dd9-4008-a3f1-2216553f98ea on hv-cinder-84327 Jun 24 10:14:08.750736 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-26764f90-af2b-4067-9e11-6114d74b14d0 req-f1820ad3-7543-4583-b722-b8712e68cb05 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031224 Jun 24 10:14:08.751341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 553/1079] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:14:25.622110 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-e7fb7800-11ef-456f-91eb-18c44ec9bcf5 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:14:25.622841 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-e7fb7800-11ef-456f-91eb-18c44ec9bcf5 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:25.625298 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_api:SELECT=22 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:14:25.625976 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=54 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:14:25.631253 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e7fb7800-11ef-456f-91eb-18c44ec9bcf5 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:25.631708 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e7fb7800-11ef-456f-91eb-18c44ec9bcf5 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:25.632522 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e7fb7800-11ef-456f-91eb-18c44ec9bcf5 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:25.633041 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e7fb7800-11ef-456f-91eb-18c44ec9bcf5 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:25.656651 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.objects.instance [None req-e7fb7800-11ef-456f-91eb-18c44ec9bcf5 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lazy-loading 'flavor' on Instance uuid 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 {{(pid=124980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:14:26.132070 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-e7fb7800-11ef-456f-91eb-18c44ec9bcf5 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "POST /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3/action" status: 202 len: 0 microversion: 2.1 time: 0.514555 Jun 24 10:14:26.132738 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 527/1080] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Jun 24 10:14:25 2022] POST /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:14:26.139535 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:14:26.142355 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=44 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:14:26.144661 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-e46ae67a-0f0f-46e4-856c-6fa3e28649d7 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:26.145391 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-e46ae67a-0f0f-46e4-856c-6fa3e28649d7 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:26.159991 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e46ae67a-0f0f-46e4-856c-6fa3e28649d7 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:26.161324 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e46ae67a-0f0f-46e4-856c-6fa3e28649d7 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:26.163310 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e46ae67a-0f0f-46e4-856c-6fa3e28649d7 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:26.164361 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e46ae67a-0f0f-46e4-856c-6fa3e28649d7 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:26.317376 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-e46ae67a-0f0f-46e4-856c-6fa3e28649d7 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:26.327578 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-e46ae67a-0f0f-46e4-856c-6fa3e28649d7 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1569 microversion: 2.1 time: 0.189815 Jun 24 10:14:26.328171 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 554/1081] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:26 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1569 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:27.347953 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-25bc8c73-9b96-4b62-bfe7-3f8158088529 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:27.348697 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-25bc8c73-9b96-4b62-bfe7-3f8158088529 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:27.355733 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-25bc8c73-9b96-4b62-bfe7-3f8158088529 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:27.356218 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-25bc8c73-9b96-4b62-bfe7-3f8158088529 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:27.356998 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-25bc8c73-9b96-4b62-bfe7-3f8158088529 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:27.357442 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-25bc8c73-9b96-4b62-bfe7-3f8158088529 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:27.509205 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-25bc8c73-9b96-4b62-bfe7-3f8158088529 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:27.517302 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-25bc8c73-9b96-4b62-bfe7-3f8158088529 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1569 microversion: 2.1 time: 0.174434 Jun 24 10:14:27.517882 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 528/1082] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:27 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:28.535547 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-9bc71487-a77f-421d-89b8-861ca948c35b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:28.536172 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-9bc71487-a77f-421d-89b8-861ca948c35b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:28.544101 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9bc71487-a77f-421d-89b8-861ca948c35b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:28.544574 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9bc71487-a77f-421d-89b8-861ca948c35b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:28.545351 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9bc71487-a77f-421d-89b8-861ca948c35b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:28.545789 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9bc71487-a77f-421d-89b8-861ca948c35b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:28.568854 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:14:28.569097 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Fri Jun 24 10:14:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 (ip 10.222.0.26) !!! Jun 24 10:14:28.687908 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-9bc71487-a77f-421d-89b8-861ca948c35b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:28.696301 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-9bc71487-a77f-421d-89b8-861ca948c35b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1569 microversion: 2.1 time: 0.164323 Jun 24 10:14:28.697411 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 555/1083] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:28 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:29.715216 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-3d132578-9a6a-4b3e-bf60-13baedd73d50 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:29.715922 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-3d132578-9a6a-4b3e-bf60-13baedd73d50 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:29.722847 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3d132578-9a6a-4b3e-bf60-13baedd73d50 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:29.723311 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3d132578-9a6a-4b3e-bf60-13baedd73d50 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:29.724111 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3d132578-9a6a-4b3e-bf60-13baedd73d50 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:29.724637 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3d132578-9a6a-4b3e-bf60-13baedd73d50 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:29.862373 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-3d132578-9a6a-4b3e-bf60-13baedd73d50 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:29.870609 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-3d132578-9a6a-4b3e-bf60-13baedd73d50 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1569 microversion: 2.1 time: 0.160114 Jun 24 10:14:29.871182 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 529/1084] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:29 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:30.889007 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-b71f70d7-5c3c-4b39-870a-0be43f7dbe3b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:30.889557 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-b71f70d7-5c3c-4b39-870a-0be43f7dbe3b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:30.896530 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b71f70d7-5c3c-4b39-870a-0be43f7dbe3b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:30.896979 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b71f70d7-5c3c-4b39-870a-0be43f7dbe3b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:30.897752 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b71f70d7-5c3c-4b39-870a-0be43f7dbe3b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:30.898830 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b71f70d7-5c3c-4b39-870a-0be43f7dbe3b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:31.038839 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-b71f70d7-5c3c-4b39-870a-0be43f7dbe3b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:31.046641 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-b71f70d7-5c3c-4b39-870a-0be43f7dbe3b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1569 microversion: 2.1 time: 0.161844 Jun 24 10:14:31.053264 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 556/1085] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:30 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:32.065427 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-420bcc0f-dd25-46d8-97f2-721fcb954fe9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:32.066042 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-420bcc0f-dd25-46d8-97f2-721fcb954fe9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:32.072587 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-420bcc0f-dd25-46d8-97f2-721fcb954fe9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:32.073036 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-420bcc0f-dd25-46d8-97f2-721fcb954fe9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:32.073802 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-420bcc0f-dd25-46d8-97f2-721fcb954fe9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:32.074453 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-420bcc0f-dd25-46d8-97f2-721fcb954fe9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:32.213949 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-420bcc0f-dd25-46d8-97f2-721fcb954fe9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:32.221879 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-420bcc0f-dd25-46d8-97f2-721fcb954fe9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1569 microversion: 2.1 time: 0.160624 Jun 24 10:14:32.222495 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 530/1086] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:32 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:33.239725 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-3ddb40b1-5ea1-4790-a44b-7c0568620467 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:33.240364 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-3ddb40b1-5ea1-4790-a44b-7c0568620467 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:33.247561 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3ddb40b1-5ea1-4790-a44b-7c0568620467 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:33.248007 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3ddb40b1-5ea1-4790-a44b-7c0568620467 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:33.248824 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3ddb40b1-5ea1-4790-a44b-7c0568620467 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:33.249252 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-3ddb40b1-5ea1-4790-a44b-7c0568620467 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:33.379773 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-3ddb40b1-5ea1-4790-a44b-7c0568620467 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:33.387417 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-3ddb40b1-5ea1-4790-a44b-7c0568620467 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1569 microversion: 2.1 time: 0.151884 Jun 24 10:14:33.387997 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 557/1087] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:33 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:34.404827 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-0aa19a18-e38d-4a20-a201-c75740ef7abd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:34.405496 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-0aa19a18-e38d-4a20-a201-c75740ef7abd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:34.412205 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0aa19a18-e38d-4a20-a201-c75740ef7abd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:34.412666 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0aa19a18-e38d-4a20-a201-c75740ef7abd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:34.413940 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0aa19a18-e38d-4a20-a201-c75740ef7abd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:34.414389 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0aa19a18-e38d-4a20-a201-c75740ef7abd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:34.548881 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-0aa19a18-e38d-4a20-a201-c75740ef7abd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:34.557440 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-0aa19a18-e38d-4a20-a201-c75740ef7abd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1569 microversion: 2.1 time: 0.156571 Jun 24 10:14:34.558007 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 531/1088] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:34 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:34.648294 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:14:34.648468 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Fri Jun 24 10:14:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:14:35.575404 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-e0555308-9f69-4093-a973-438854dea242 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:35.577963 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-e0555308-9f69-4093-a973-438854dea242 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:35.582804 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e0555308-9f69-4093-a973-438854dea242 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:35.583253 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e0555308-9f69-4093-a973-438854dea242 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:35.584034 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e0555308-9f69-4093-a973-438854dea242 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:35.584552 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e0555308-9f69-4093-a973-438854dea242 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:35.722740 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-e0555308-9f69-4093-a973-438854dea242 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:35.730873 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-e0555308-9f69-4093-a973-438854dea242 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1569 microversion: 2.1 time: 0.159440 Jun 24 10:14:35.731455 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 558/1089] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:35 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:36.749427 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-9da0ef20-503f-4f90-8f4e-4dbac24871a9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:36.750234 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-9da0ef20-503f-4f90-8f4e-4dbac24871a9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:36.756787 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9da0ef20-503f-4f90-8f4e-4dbac24871a9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:36.757755 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9da0ef20-503f-4f90-8f4e-4dbac24871a9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:36.758541 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9da0ef20-503f-4f90-8f4e-4dbac24871a9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:36.759031 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-9da0ef20-503f-4f90-8f4e-4dbac24871a9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:36.989098 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-9da0ef20-503f-4f90-8f4e-4dbac24871a9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:36.989900 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-9da0ef20-503f-4f90-8f4e-4dbac24871a9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1569 microversion: 2.1 time: 0.245517 Jun 24 10:14:36.990484 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 532/1090] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:36 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1569 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:38.007837 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-75ba3c8b-3016-44b4-aba3-888a0611d18b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:38.008462 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-75ba3c8b-3016-44b4-aba3-888a0611d18b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:38.015324 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-75ba3c8b-3016-44b4-aba3-888a0611d18b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:38.015783 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-75ba3c8b-3016-44b4-aba3-888a0611d18b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:38.016685 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-75ba3c8b-3016-44b4-aba3-888a0611d18b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:38.017141 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-75ba3c8b-3016-44b4-aba3-888a0611d18b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:38.158992 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-75ba3c8b-3016-44b4-aba3-888a0611d18b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:38.167216 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-75ba3c8b-3016-44b4-aba3-888a0611d18b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1569 microversion: 2.1 time: 0.163544 Jun 24 10:14:38.167782 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 559/1091] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:38 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:39.185577 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-e4a04370-75bd-408c-8345-212b80661053 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:39.186292 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-e4a04370-75bd-408c-8345-212b80661053 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:39.192926 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e4a04370-75bd-408c-8345-212b80661053 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:39.193378 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e4a04370-75bd-408c-8345-212b80661053 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:39.194153 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e4a04370-75bd-408c-8345-212b80661053 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:39.194595 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-e4a04370-75bd-408c-8345-212b80661053 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:39.326235 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-e4a04370-75bd-408c-8345-212b80661053 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:39.333768 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-e4a04370-75bd-408c-8345-212b80661053 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1569 microversion: 2.1 time: 0.152128 Jun 24 10:14:39.334336 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 533/1092] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:39 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:40.352648 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-2d7cd24c-11f3-47ef-97f7-6718c96c4add tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:40.353388 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-2d7cd24c-11f3-47ef-97f7-6718c96c4add tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:40.360192 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2d7cd24c-11f3-47ef-97f7-6718c96c4add tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:40.360645 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2d7cd24c-11f3-47ef-97f7-6718c96c4add tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:40.361418 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2d7cd24c-11f3-47ef-97f7-6718c96c4add tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:40.361859 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2d7cd24c-11f3-47ef-97f7-6718c96c4add tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:40.499338 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-2d7cd24c-11f3-47ef-97f7-6718c96c4add tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:40.507742 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-2d7cd24c-11f3-47ef-97f7-6718c96c4add tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1570 microversion: 2.1 time: 0.159097 Jun 24 10:14:40.508348 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 560/1093] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:40 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:40.526393 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-744ffb47-9f43-4300-bec6-1c37e89c6a7e tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:14:40.526980 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-744ffb47-9f43-4300-bec6-1c37e89c6a7e tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:40.533862 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-744ffb47-9f43-4300-bec6-1c37e89c6a7e tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:40.534422 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-744ffb47-9f43-4300-bec6-1c37e89c6a7e tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:40.535227 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-744ffb47-9f43-4300-bec6-1c37e89c6a7e tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:40.535671 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-744ffb47-9f43-4300-bec6-1c37e89c6a7e tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:40.948150 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-744ffb47-9f43-4300-bec6-1c37e89c6a7e tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "POST /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3/action" status: 202 len: 0 microversion: 2.1 time: 0.426132 Jun 24 10:14:40.949361 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 534/1094] 10.222.0.26 () {60 vars in 1277 bytes} [Fri Jun 24 10:14:40 2022] POST /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:14:40.957955 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-9048f436-355b-4e0b-b9c2-95dd8b9f38e1 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:40.959265 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-9048f436-355b-4e0b-b9c2-95dd8b9f38e1 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:40.967924 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9048f436-355b-4e0b-b9c2-95dd8b9f38e1 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:40.968492 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9048f436-355b-4e0b-b9c2-95dd8b9f38e1 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:40.969432 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9048f436-355b-4e0b-b9c2-95dd8b9f38e1 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:40.970037 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9048f436-355b-4e0b-b9c2-95dd8b9f38e1 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:41.166913 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-9048f436-355b-4e0b-b9c2-95dd8b9f38e1 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:41.174990 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-9048f436-355b-4e0b-b9c2-95dd8b9f38e1 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1518 microversion: 2.1 time: 0.221025 Jun 24 10:14:41.175933 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 561/1095] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:40 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1518 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:41.784723 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-ee298df3-0172-42a8-98b4-64add196024c req-fcb52d7c-b5a6-4f14-873c-0989c4f6d2a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a43dc1-7e32-45bd-a007-1f9eb0fcedb3", "name": "network-vif-unplugged", "status": "completed", "tag": "27d385ce-eca4-4188-828a-5f898681a1fe"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:14:41.791159 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-ee298df3-0172-42a8-98b4-64add196024c req-fcb52d7c-b5a6-4f14-873c-0989c4f6d2a7 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:41.791940 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-ee298df3-0172-42a8-98b4-64add196024c req-fcb52d7c-b5a6-4f14-873c-0989c4f6d2a7 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:41.810572 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.compute.server_external_events [req-ee298df3-0172-42a8-98b4-64add196024c req-fcb52d7c-b5a6-4f14-873c-0989c4f6d2a7 service nova] Unable to find a host for instance 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3. Dropping event network-vif-unplugged {{(pid=124980) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 24 10:14:41.812206 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-ee298df3-0172-42a8-98b4-64add196024c req-fcb52d7c-b5a6-4f14-873c-0989c4f6d2a7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.043761 Jun 24 10:14:41.813290 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 535/1096] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 46 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 24 10:14:42.198791 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-d12a40c8-1edf-44c9-a966-e5202780483e tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:42.199824 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-d12a40c8-1edf-44c9-a966-e5202780483e tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:42.206048 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d12a40c8-1edf-44c9-a966-e5202780483e tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:42.206497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d12a40c8-1edf-44c9-a966-e5202780483e tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:42.207268 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d12a40c8-1edf-44c9-a966-e5202780483e tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:42.207697 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-d12a40c8-1edf-44c9-a966-e5202780483e tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:42.356266 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-d12a40c8-1edf-44c9-a966-e5202780483e tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:42.364249 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-d12a40c8-1edf-44c9-a966-e5202780483e tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1518 microversion: 2.1 time: 0.169836 Jun 24 10:14:42.364822 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 562/1097] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:42 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:43.381883 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-6d6ab39f-04bf-49fa-be71-1b884e4c467b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:43.382741 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-6d6ab39f-04bf-49fa-be71-1b884e4c467b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:43.390381 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6d6ab39f-04bf-49fa-be71-1b884e4c467b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:43.390874 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6d6ab39f-04bf-49fa-be71-1b884e4c467b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:43.391670 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6d6ab39f-04bf-49fa-be71-1b884e4c467b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:43.392116 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6d6ab39f-04bf-49fa-be71-1b884e4c467b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:43.541942 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-6d6ab39f-04bf-49fa-be71-1b884e4c467b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:43.550317 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-6d6ab39f-04bf-49fa-be71-1b884e4c467b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1520 microversion: 2.1 time: 0.172272 Jun 24 10:14:43.550922 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 536/1098] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:43 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:44.573128 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-b4306bf6-3678-48d1-a0c9-79863ce57ee4 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:44.574318 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-b4306bf6-3678-48d1-a0c9-79863ce57ee4 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:44.586522 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b4306bf6-3678-48d1-a0c9-79863ce57ee4 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:44.587306 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b4306bf6-3678-48d1-a0c9-79863ce57ee4 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:44.588755 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b4306bf6-3678-48d1-a0c9-79863ce57ee4 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:44.589466 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b4306bf6-3678-48d1-a0c9-79863ce57ee4 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:44.740908 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-b4306bf6-3678-48d1-a0c9-79863ce57ee4 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:44.750973 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-b4306bf6-3678-48d1-a0c9-79863ce57ee4 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1576 microversion: 2.1 time: 0.185342 Jun 24 10:14:44.760367 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 563/1099] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:44 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1576 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:45.773972 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-7cf3e85c-b384-45ff-a6ca-a850a1b5e495 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:45.774672 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-7cf3e85c-b384-45ff-a6ca-a850a1b5e495 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:45.782142 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7cf3e85c-b384-45ff-a6ca-a850a1b5e495 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:45.782722 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7cf3e85c-b384-45ff-a6ca-a850a1b5e495 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:45.783713 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7cf3e85c-b384-45ff-a6ca-a850a1b5e495 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:45.784312 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-7cf3e85c-b384-45ff-a6ca-a850a1b5e495 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:45.925599 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-7cf3e85c-b384-45ff-a6ca-a850a1b5e495 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:45.933716 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-7cf3e85c-b384-45ff-a6ca-a850a1b5e495 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1576 microversion: 2.1 time: 0.164614 Jun 24 10:14:45.934291 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 537/1100] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:45 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:46.956355 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-24b49802-c803-4196-8a9a-4e3817a47d77 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:46.956913 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-24b49802-c803-4196-8a9a-4e3817a47d77 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:46.964057 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-24b49802-c803-4196-8a9a-4e3817a47d77 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:46.964645 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-24b49802-c803-4196-8a9a-4e3817a47d77 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:46.965400 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-24b49802-c803-4196-8a9a-4e3817a47d77 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:46.965827 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-24b49802-c803-4196-8a9a-4e3817a47d77 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:47.108797 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-24b49802-c803-4196-8a9a-4e3817a47d77 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:47.116739 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-24b49802-c803-4196-8a9a-4e3817a47d77 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1576 microversion: 2.1 time: 0.164542 Jun 24 10:14:47.117317 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 564/1101] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:46 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:48.133771 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-f4f9f6db-c459-4bf4-a7bd-5c502658a632 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:48.135008 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-f4f9f6db-c459-4bf4-a7bd-5c502658a632 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:48.141432 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f4f9f6db-c459-4bf4-a7bd-5c502658a632 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:48.141889 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f4f9f6db-c459-4bf4-a7bd-5c502658a632 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:48.142656 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f4f9f6db-c459-4bf4-a7bd-5c502658a632 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:48.143100 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f4f9f6db-c459-4bf4-a7bd-5c502658a632 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:48.284465 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-f4f9f6db-c459-4bf4-a7bd-5c502658a632 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:48.292507 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-f4f9f6db-c459-4bf4-a7bd-5c502658a632 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1576 microversion: 2.1 time: 0.162723 Jun 24 10:14:48.293076 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 538/1102] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:48 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:49.311992 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-b82e7572-c408-43ef-878f-93f558780b7b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:49.313055 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-b82e7572-c408-43ef-878f-93f558780b7b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:49.319412 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b82e7572-c408-43ef-878f-93f558780b7b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:49.319865 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b82e7572-c408-43ef-878f-93f558780b7b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:49.320665 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b82e7572-c408-43ef-878f-93f558780b7b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:49.321100 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b82e7572-c408-43ef-878f-93f558780b7b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:49.457069 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-b82e7572-c408-43ef-878f-93f558780b7b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:49.465273 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-b82e7572-c408-43ef-878f-93f558780b7b tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1576 microversion: 2.1 time: 0.158912 Jun 24 10:14:49.465846 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 565/1103] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:49 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:50.483752 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-efeb1e6f-6654-4c6b-bf02-7e55631aa89c tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:50.484428 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-efeb1e6f-6654-4c6b-bf02-7e55631aa89c tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:50.491003 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-efeb1e6f-6654-4c6b-bf02-7e55631aa89c tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:50.491445 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-efeb1e6f-6654-4c6b-bf02-7e55631aa89c tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:50.492243 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-efeb1e6f-6654-4c6b-bf02-7e55631aa89c tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:50.492678 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-efeb1e6f-6654-4c6b-bf02-7e55631aa89c tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:50.634262 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-efeb1e6f-6654-4c6b-bf02-7e55631aa89c tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:50.641902 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-efeb1e6f-6654-4c6b-bf02-7e55631aa89c tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1576 microversion: 2.1 time: 0.162109 Jun 24 10:14:50.642501 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 539/1104] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:50 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:51.659122 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-40bc46aa-e9d3-44a1-8647-2b81c88b5b81 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:51.659874 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-40bc46aa-e9d3-44a1-8647-2b81c88b5b81 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:51.666941 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-40bc46aa-e9d3-44a1-8647-2b81c88b5b81 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:51.667396 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-40bc46aa-e9d3-44a1-8647-2b81c88b5b81 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:51.668467 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-40bc46aa-e9d3-44a1-8647-2b81c88b5b81 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:51.670996 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-40bc46aa-e9d3-44a1-8647-2b81c88b5b81 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:51.838185 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-40bc46aa-e9d3-44a1-8647-2b81c88b5b81 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:51.846520 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-40bc46aa-e9d3-44a1-8647-2b81c88b5b81 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1576 microversion: 2.1 time: 0.191172 Jun 24 10:14:51.847198 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 566/1105] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:51 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1576 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:52.863705 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-350c9e2a-7484-4ee1-b0cd-edfdeef464d9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:52.864354 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-350c9e2a-7484-4ee1-b0cd-edfdeef464d9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:52.871093 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-350c9e2a-7484-4ee1-b0cd-edfdeef464d9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:52.871537 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-350c9e2a-7484-4ee1-b0cd-edfdeef464d9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:52.872346 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-350c9e2a-7484-4ee1-b0cd-edfdeef464d9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:52.872784 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-350c9e2a-7484-4ee1-b0cd-edfdeef464d9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:53.016625 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-350c9e2a-7484-4ee1-b0cd-edfdeef464d9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:53.024429 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-350c9e2a-7484-4ee1-b0cd-edfdeef464d9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1576 microversion: 2.1 time: 0.164432 Jun 24 10:14:53.025202 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 540/1106] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:52 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:53.868447 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-93b4ce54-4d1d-4577-815c-5c5391e4fe98 req-85df89da-b1af-49fa-93b2-a6634c45534a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a43dc1-7e32-45bd-a007-1f9eb0fcedb3", "name": "network-vif-plugged", "status": "completed", "tag": "27d385ce-eca4-4188-828a-5f898681a1fe"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:14:53.878389 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-93b4ce54-4d1d-4577-815c-5c5391e4fe98 req-85df89da-b1af-49fa-93b2-a6634c45534a service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:53.878902 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-93b4ce54-4d1d-4577-815c-5c5391e4fe98 req-85df89da-b1af-49fa-93b2-a6634c45534a service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:53.890638 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-93b4ce54-4d1d-4577-815c-5c5391e4fe98 req-85df89da-b1af-49fa-93b2-a6634c45534a service nova] Creating event network-vif-plugged:27d385ce-eca4-4188-828a-5f898681a1fe for instance 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 on hv-cinder-84327 Jun 24 10:14:53.896267 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-93b4ce54-4d1d-4577-815c-5c5391e4fe98 req-85df89da-b1af-49fa-93b2-a6634c45534a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031697 Jun 24 10:14:53.896885 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 567/1107] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:14:54.043097 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-66db901c-a629-4947-a5a5-41a115f6f764 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:54.043775 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-66db901c-a629-4947-a5a5-41a115f6f764 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:54.051415 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-66db901c-a629-4947-a5a5-41a115f6f764 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:54.051867 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-66db901c-a629-4947-a5a5-41a115f6f764 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:54.052663 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-66db901c-a629-4947-a5a5-41a115f6f764 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:54.053103 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-66db901c-a629-4947-a5a5-41a115f6f764 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:54.057561 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:14:54.204897 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-66db901c-a629-4947-a5a5-41a115f6f764 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:54.212794 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-66db901c-a629-4947-a5a5-41a115f6f764 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1576 microversion: 2.1 time: 0.174242 Jun 24 10:14:54.213872 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 541/1108] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:54 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:55.232119 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-282667e2-cfd4-4a96-9c40-2da18ee106d9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:55.232914 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-282667e2-cfd4-4a96-9c40-2da18ee106d9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:55.239980 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-282667e2-cfd4-4a96-9c40-2da18ee106d9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:55.240510 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-282667e2-cfd4-4a96-9c40-2da18ee106d9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:55.241292 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-282667e2-cfd4-4a96-9c40-2da18ee106d9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:55.241732 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-282667e2-cfd4-4a96-9c40-2da18ee106d9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:55.376919 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-282667e2-cfd4-4a96-9c40-2da18ee106d9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:55.385520 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-282667e2-cfd4-4a96-9c40-2da18ee106d9 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1576 microversion: 2.1 time: 0.158262 Jun 24 10:14:55.386106 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 568/1109] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:55 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:14:56.403069 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-97c9deac-3b33-4234-a0ed-fc90c0c3b1b8 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:56.403737 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-97c9deac-3b33-4234-a0ed-fc90c0c3b1b8 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:14:56.406419 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_api:SELECT=33 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:14:56.411573 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-97c9deac-3b33-4234-a0ed-fc90c0c3b1b8 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:56.416822 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-97c9deac-3b33-4234-a0ed-fc90c0c3b1b8 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:56.416822 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-97c9deac-3b33-4234-a0ed-fc90c0c3b1b8 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:56.416822 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-97c9deac-3b33-4234-a0ed-fc90c0c3b1b8 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:56.823708 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-97c9deac-3b33-4234-a0ed-fc90c0c3b1b8 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:14:56.831381 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-97c9deac-3b33-4234-a0ed-fc90c0c3b1b8 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1563 microversion: 2.1 time: 0.432493 Jun 24 10:14:56.831950 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 542/1110] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:14:56 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1563 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:06.094920 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_api:SELECT=30 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:16:06.095761 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=86 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:16:06.099758 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-79214316-7a58-4178-9a72-7ec9ff6666eb tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:06.100289 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-79214316-7a58-4178-9a72-7ec9ff6666eb tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 40064e94-9dd9-4008-a3f1-2216553f98ea] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:06.107393 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-79214316-7a58-4178-9a72-7ec9ff6666eb tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:06.111299 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-79214316-7a58-4178-9a72-7ec9ff6666eb tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:06.111299 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-79214316-7a58-4178-9a72-7ec9ff6666eb tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:06.111299 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-79214316-7a58-4178-9a72-7ec9ff6666eb tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:06.133946 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-79214316-7a58-4178-9a72-7ec9ff6666eb tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 40064e94-9dd9-4008-a3f1-2216553f98ea] Going to try to terminate instance {{(pid=124979) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:16:06.685111 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-79214316-7a58-4178-9a72-7ec9ff6666eb tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "DELETE /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea" status: 204 len: 0 microversion: 2.1 time: 0.591754 Jun 24 10:16:06.685985 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 569/1111] 10.222.0.26 () {58 vars in 1238 bytes} [Fri Jun 24 10:16:06 2022] DELETE /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea => generated 0 bytes in 593 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:16:06.691677 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_api:SELECT=1 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:16:06.699557 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=10 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:16:06.699557 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-0fde64eb-16d2-4e21-8300-d5a0ed03929c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:06.699557 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-0fde64eb-16d2-4e21-8300-d5a0ed03929c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 40064e94-9dd9-4008-a3f1-2216553f98ea] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:06.703546 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0fde64eb-16d2-4e21-8300-d5a0ed03929c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:06.703990 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0fde64eb-16d2-4e21-8300-d5a0ed03929c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:06.704798 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0fde64eb-16d2-4e21-8300-d5a0ed03929c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:06.705237 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-0fde64eb-16d2-4e21-8300-d5a0ed03929c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:06.902648 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-0fde64eb-16d2-4e21-8300-d5a0ed03929c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:06.910558 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-0fde64eb-16d2-4e21-8300-d5a0ed03929c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea" status: 200 len: 1576 microversion: 2.1 time: 0.220484 Jun 24 10:16:06.911142 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 543/1112] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:06 2022] GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea => generated 1576 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:07.929347 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-0d69aa98-50ed-4b97-8908-da8e87091a87 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:07.930002 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-0d69aa98-50ed-4b97-8908-da8e87091a87 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 40064e94-9dd9-4008-a3f1-2216553f98ea] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:07.937184 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0d69aa98-50ed-4b97-8908-da8e87091a87 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:07.937635 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0d69aa98-50ed-4b97-8908-da8e87091a87 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:07.938461 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0d69aa98-50ed-4b97-8908-da8e87091a87 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:07.938902 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0d69aa98-50ed-4b97-8908-da8e87091a87 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:08.137152 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:16:08.137789 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Fri Jun 24 10:16:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:16:08.143935 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-0d69aa98-50ed-4b97-8908-da8e87091a87 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:08.152798 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-0d69aa98-50ed-4b97-8908-da8e87091a87 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea" status: 200 len: 1576 microversion: 2.1 time: 0.228193 Jun 24 10:16:08.153386 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 570/1113] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:07 2022] GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea => generated 1576 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:09.170544 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-d8e506fa-1c48-41f1-9b9b-18c068c381af tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:09.171138 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-d8e506fa-1c48-41f1-9b9b-18c068c381af tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 40064e94-9dd9-4008-a3f1-2216553f98ea] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:09.179063 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d8e506fa-1c48-41f1-9b9b-18c068c381af tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:09.183683 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d8e506fa-1c48-41f1-9b9b-18c068c381af tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:09.183683 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d8e506fa-1c48-41f1-9b9b-18c068c381af tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:09.183683 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d8e506fa-1c48-41f1-9b9b-18c068c381af tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:09.272931 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d8e506fa-1c48-41f1-9b9b-18c068c381af tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:09.289421 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-d8e506fa-1c48-41f1-9b9b-18c068c381af tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea" status: 200 len: 1508 microversion: 2.1 time: 0.121605 Jun 24 10:16:09.289421 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 544/1114] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:09 2022] GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea => generated 1508 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:09.598463 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-59110fe3-6202-4097-bc60-63dd389d083d req-65b030cc-3f9b-42d0-95a7-029c8ea46536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40064e94-9dd9-4008-a3f1-2216553f98ea", "name": "network-vif-deleted", "tag": "6e3e55b4-6466-411b-bd31-f471d4be88fe"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:16:09.606805 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-59110fe3-6202-4097-bc60-63dd389d083d req-65b030cc-3f9b-42d0-95a7-029c8ea46536 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:09.613206 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-59110fe3-6202-4097-bc60-63dd389d083d req-65b030cc-3f9b-42d0-95a7-029c8ea46536 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:09.622869 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-59110fe3-6202-4097-bc60-63dd389d083d req-65b030cc-3f9b-42d0-95a7-029c8ea46536 service nova] Creating event network-vif-deleted:6e3e55b4-6466-411b-bd31-f471d4be88fe for instance 40064e94-9dd9-4008-a3f1-2216553f98ea on hv-cinder-84327 Jun 24 10:16:09.631288 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-59110fe3-6202-4097-bc60-63dd389d083d req-65b030cc-3f9b-42d0-95a7-029c8ea46536 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037081 Jun 24 10:16:09.631911 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 571/1115] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:16:10.312844 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-fe40132e-6f8f-409c-a165-7c9a16547026 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:10.313575 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-fe40132e-6f8f-409c-a165-7c9a16547026 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 40064e94-9dd9-4008-a3f1-2216553f98ea] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:10.320546 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-fe40132e-6f8f-409c-a165-7c9a16547026 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:10.321033 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-fe40132e-6f8f-409c-a165-7c9a16547026 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:10.321824 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-fe40132e-6f8f-409c-a165-7c9a16547026 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:10.322259 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-fe40132e-6f8f-409c-a165-7c9a16547026 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:10.398197 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-fe40132e-6f8f-409c-a165-7c9a16547026 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:10.410027 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-fe40132e-6f8f-409c-a165-7c9a16547026 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea" status: 200 len: 1225 microversion: 2.1 time: 0.100632 Jun 24 10:16:10.411376 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 545/1116] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:10 2022] GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:11.433549 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-b4d42e14-a773-4977-8444-bc4cba0418de tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:11.434165 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-b4d42e14-a773-4977-8444-bc4cba0418de tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 40064e94-9dd9-4008-a3f1-2216553f98ea] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:11.442131 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b4d42e14-a773-4977-8444-bc4cba0418de tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:11.447113 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b4d42e14-a773-4977-8444-bc4cba0418de tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:11.447113 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b4d42e14-a773-4977-8444-bc4cba0418de tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:11.447113 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-b4d42e14-a773-4977-8444-bc4cba0418de tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:11.460698 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-b4d42e14-a773-4977-8444-bc4cba0418de tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] HTTP exception thrown: Instance 40064e94-9dd9-4008-a3f1-2216553f98ea could not be found. Jun 24 10:16:11.462400 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-b4d42e14-a773-4977-8444-bc4cba0418de tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Request method failure captured: Jun 24 10:16:11.462400 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea HTTP/1.1 Jun 24 10:16:11.462400 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:16:11.462400 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:16:11.462400 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:16:11.462400 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 0 Jun 24 10:16:11.462400 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:16:11.462400 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:16:11.462400 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:16:11.462400 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:16:11.462400 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitY4-mZzxoWEv_LI9TYi1AzdmQ7G-PR0BrmJqvZvKXoIalr0MomVzZ-fihaxe0TZ7uOZcJ55kBNa-DKOp71AdPyugpp77X6EbAX2vKGVnsRuWX9n53vPkBOoNKbXKbXWr9T75Md29KBwnYNhIGaO9sd3edR5iuLrDrQRn8ojNSsEJCmU Jun 24 10:16:11.462400 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:16:11.462400 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:16:11.462400 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:16:11.462400 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:16:11.462400 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:16:11.462400 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:16:11.462400 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: 2ea76e34ae2a4569851abd4e596b5e77 Jun 24 10:16:11.462400 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-TestVolumeBootPattern-1176966912 Jun 24 10:16:11.462400 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:16:11.462400 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:16:11.464217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2ea76e34ae2a4569851abd4e596b5e77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2ea76e34ae2a4569851abd4e596b5e77", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2ea76e34ae2a4569851abd4e596b5e77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2ea76e34ae2a4569851abd4e596b5e77"}]}] Jun 24 10:16:11.464217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-TestVolumeBootPattern-1176966912 Jun 24 10:16:11.464217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: 2ea76e34ae2a4569851abd4e596b5e77 Jun 24 10:16:11.464217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-TestVolumeBootPattern-1176966912 Jun 24 10:16:11.464217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-TestVolumeBootPattern-1176966912-project Jun 24 10:16:11.464217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:16:11.464217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:16:11.464217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: 40db8a50905141ffb83d84d83065952b Jun 24 10:16:11.464217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-TestVolumeBootPattern-1176966912-project Jun 24 10:16:11.464217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: > Jun 24 10:16:11.464217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Instance 40064e94-9dd9-4008-a3f1-2216553f98ea could not be found. Jun 24 10:16:11.464217 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'id': '40064e94-9dd9-4008-a3f1-2216553f98ea'} Jun 24 10:16:11.465310 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:16:11.465310 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:16:11.465310 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:16:11.465310 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:16:11.465310 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:16:11.465310 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:16:11.465310 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:16:11.465310 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:16:11.465310 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:16:11.465310 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:16:11.465310 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40064e94-9dd9-4008-a3f1-2216553f98ea could not be found. Jun 24 10:16:11.465310 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:16:11.465310 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:16:11.465310 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:16:11.465310 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:16:11.465310 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:16:11.465310 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:16:11.465310 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:16:11.465310 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:16:11.465310 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:16:11.466950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:16:11.466950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:16:11.466950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:16:11.466950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:16:11.466950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:16:11.466950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:16:11.466950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:16:11.466950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40064e94-9dd9-4008-a3f1-2216553f98ea could not be found. Jun 24 10:16:11.466950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:16:11.466950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:16:11.466950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:16:11.466950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:16:11.466950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:16:11.466950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:16:11.466950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:16:11.466950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:16:11.466950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40064e94-9dd9-4008-a3f1-2216553f98ea could not be found. Jun 24 10:16:11.466950 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:16:11.473749 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-b4d42e14-a773-4977-8444-bc4cba0418de tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Returning 404 to user: Instance 40064e94-9dd9-4008-a3f1-2216553f98ea could not be found. {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:16:11.473749 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-b4d42e14-a773-4977-8444-bc4cba0418de tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea" status: 404 len: 111 microversion: 2.1 time: 0.035638 Jun 24 10:16:11.473749 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 572/1117] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:11 2022] GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:16:11.512872 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-94510324-6f70-4710-a886-6b1ba62a8edd tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1603812574", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1794596080", "security_groups": [{"name": "tempest-secgroup-smoke-1633595985"}], "block_device_mapping_v2": [{"uuid": "e0aed391-3459-425d-a115-213605c13277", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7e0493cf-9922-46cd-9f38-42fd8c5fc022"}]}} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:16:11.637269 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.network.neutron [None req-94510324-6f70-4710-a886-6b1ba62a8edd tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] validate_networks() for [('7e0493cf-9922-46cd-9f38-42fd8c5fc022', None, None, None, None, None)] {{(pid=124980) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:16:12.098418 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-94510324-6f70-4710-a886-6b1ba62a8edd tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Flavor limits 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:16:12.098911 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-94510324-6f70-4710-a886-6b1ba62a8edd tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Image limits 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:16:12.099478 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-94510324-6f70-4710-a886-6b1ba62a8edd tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Flavor pref 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:16:12.099898 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-94510324-6f70-4710-a886-6b1ba62a8edd tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Image pref 0:0:0 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:16:12.100350 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.virt.hardware [None req-94510324-6f70-4710-a886-6b1ba62a8edd tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124980) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:16:12.110480 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-94510324-6f70-4710-a886-6b1ba62a8edd tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:12.110974 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-94510324-6f70-4710-a886-6b1ba62a8edd tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:12.111800 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-94510324-6f70-4710-a886-6b1ba62a8edd tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:12.112262 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-94510324-6f70-4710-a886-6b1ba62a8edd tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:12.130287 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-94510324-6f70-4710-a886-6b1ba62a8edd tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Getting quotas for project 2ea76e34ae2a4569851abd4e596b5e77. Resources: {'instances', 'cores', 'ram'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:16:12.134424 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.quota [None req-94510324-6f70-4710-a886-6b1ba62a8edd tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Getting quotas for user 40db8a50905141ffb83d84d83065952b and project 2ea76e34ae2a4569851abd4e596b5e77. Resources: {'instances', 'cores', 'ram'} {{(pid=124980) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:16:12.196762 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-94510324-6f70-4710-a886-6b1ba62a8edd tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Going to run 1 instances... {{(pid=124980) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:16:12.198850 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-94510324-6f70-4710-a886-6b1ba62a8edd tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 9c5d21f0-8a41-4c83-9c59-4233690febf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e0aed391-3459-425d-a115-213605c13277',volume_size=None,volume_type=None)] {{(pid=124980) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:16:12.704645 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-94510324-6f70-4710-a886-6b1ba62a8edd tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.197749 Jun 24 10:16:12.705582 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 546/1118] 10.222.0.26 () {60 vars in 1146 bytes} [Fri Jun 24 10:16:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:16:12.715639 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-38d3001e-f509-42bb-9c1d-38a4237e9f72 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:12.716298 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-38d3001e-f509-42bb-9c1d-38a4237e9f72 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 9c5d21f0-8a41-4c83-9c59-4233690febf1] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:12.779614 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-38d3001e-f509-42bb-9c1d-38a4237e9f72 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:12.787421 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-38d3001e-f509-42bb-9c1d-38a4237e9f72 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1" status: 200 len: 1095 microversion: 2.1 time: 0.075775 Jun 24 10:16:12.788338 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 573/1119] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:12 2022] GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1 => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:13.737104 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-f6c9f337-d8ce-402a-94e8-531d32cf8e3a req-e5233bea-0ca0-417d-8cd5-f74f048845a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82a43dc1-7e32-45bd-a007-1f9eb0fcedb3", "tag": "27d385ce-eca4-4188-828a-5f898681a1fe"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:16:13.739061 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-d3379bbb-b7ea-4369-9d07-5366dfe9b69a tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:13.739952 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-d3379bbb-b7ea-4369-9d07-5366dfe9b69a tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:13.748087 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-f6c9f337-d8ce-402a-94e8-531d32cf8e3a req-e5233bea-0ca0-417d-8cd5-f74f048845a9 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:13.748739 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-f6c9f337-d8ce-402a-94e8-531d32cf8e3a req-e5233bea-0ca0-417d-8cd5-f74f048845a9 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:13.752762 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d3379bbb-b7ea-4369-9d07-5366dfe9b69a tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:13.753860 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d3379bbb-b7ea-4369-9d07-5366dfe9b69a tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:13.755266 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d3379bbb-b7ea-4369-9d07-5366dfe9b69a tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:13.756352 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d3379bbb-b7ea-4369-9d07-5366dfe9b69a tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:13.760466 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-f6c9f337-d8ce-402a-94e8-531d32cf8e3a req-e5233bea-0ca0-417d-8cd5-f74f048845a9 service nova] Creating event network-changed:27d385ce-eca4-4188-828a-5f898681a1fe for instance 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 on hv-cinder-84327 Jun 24 10:16:13.766540 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-f6c9f337-d8ce-402a-94e8-531d32cf8e3a req-e5233bea-0ca0-417d-8cd5-f74f048845a9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034393 Jun 24 10:16:13.767230 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 574/1120] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:16:13.806780 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-d3379bbb-b7ea-4369-9d07-5366dfe9b69a tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Going to try to terminate instance {{(pid=124980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:16:13.807114 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-15a242da-d174-4956-92cd-b4899e1fd6ca tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:13.808300 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-15a242da-d174-4956-92cd-b4899e1fd6ca tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 9c5d21f0-8a41-4c83-9c59-4233690febf1] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:13.820512 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-15a242da-d174-4956-92cd-b4899e1fd6ca tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:13.822203 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-15a242da-d174-4956-92cd-b4899e1fd6ca tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:13.823564 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-15a242da-d174-4956-92cd-b4899e1fd6ca tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:13.826915 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-15a242da-d174-4956-92cd-b4899e1fd6ca tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:13.926010 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-15a242da-d174-4956-92cd-b4899e1fd6ca tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:13.939974 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-15a242da-d174-4956-92cd-b4899e1fd6ca tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1" status: 200 len: 1145 microversion: 2.1 time: 0.139327 Jun 24 10:16:13.940599 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 575/1121] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:13 2022] GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1 => generated 1145 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:16:14.165057 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-d3379bbb-b7ea-4369-9d07-5366dfe9b69a tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "DELETE /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 204 len: 0 microversion: 2.1 time: 0.433697 Jun 24 10:16:14.165918 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 547/1122] 10.222.0.26 () {58 vars in 1238 bytes} [Fri Jun 24 10:16:13 2022] DELETE /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 10:16:14.177231 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-ab040c0d-3a31-4bb1-8098-f935e58e1ddd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:14.178815 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-ab040c0d-3a31-4bb1-8098-f935e58e1ddd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:14.190779 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ab040c0d-3a31-4bb1-8098-f935e58e1ddd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:14.191731 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ab040c0d-3a31-4bb1-8098-f935e58e1ddd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:14.192939 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ab040c0d-3a31-4bb1-8098-f935e58e1ddd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:14.193628 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ab040c0d-3a31-4bb1-8098-f935e58e1ddd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:14.346676 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-ab040c0d-3a31-4bb1-8098-f935e58e1ddd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:14.355651 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-ab040c0d-3a31-4bb1-8098-f935e58e1ddd tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1569 microversion: 2.1 time: 0.184409 Jun 24 10:16:14.356383 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 576/1123] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:14 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:14.958655 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-3d0e4595-24de-4f65-b7ad-6725fbb42e02 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:14.959273 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-3d0e4595-24de-4f65-b7ad-6725fbb42e02 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 9c5d21f0-8a41-4c83-9c59-4233690febf1] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:14.966152 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3d0e4595-24de-4f65-b7ad-6725fbb42e02 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:14.966609 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3d0e4595-24de-4f65-b7ad-6725fbb42e02 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:14.967391 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3d0e4595-24de-4f65-b7ad-6725fbb42e02 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:14.967837 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3d0e4595-24de-4f65-b7ad-6725fbb42e02 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:15.032336 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-3d0e4595-24de-4f65-b7ad-6725fbb42e02 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:15.040014 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-3d0e4595-24de-4f65-b7ad-6725fbb42e02 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1" status: 200 len: 1137 microversion: 2.1 time: 0.085676 Jun 24 10:16:15.040680 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 548/1124] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:14 2022] GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1 => generated 1137 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:16:15.374356 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-109e8012-b8b1-4e07-8742-bd32fc356ae1 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:15.374952 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-109e8012-b8b1-4e07-8742-bd32fc356ae1 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:15.381677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-109e8012-b8b1-4e07-8742-bd32fc356ae1 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:15.382112 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-109e8012-b8b1-4e07-8742-bd32fc356ae1 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:15.382894 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-109e8012-b8b1-4e07-8742-bd32fc356ae1 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:15.383331 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-109e8012-b8b1-4e07-8742-bd32fc356ae1 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:15.521358 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-109e8012-b8b1-4e07-8742-bd32fc356ae1 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:15.529513 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-109e8012-b8b1-4e07-8742-bd32fc356ae1 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1569 microversion: 2.1 time: 0.159032 Jun 24 10:16:15.530371 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 577/1125] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:15 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:16.057482 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-5e9d737f-6496-407a-9873-6d999487437d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:16.058217 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-5e9d737f-6496-407a-9873-6d999487437d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 9c5d21f0-8a41-4c83-9c59-4233690febf1] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:16.065589 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5e9d737f-6496-407a-9873-6d999487437d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:16.067722 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5e9d737f-6496-407a-9873-6d999487437d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:16.067722 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5e9d737f-6496-407a-9873-6d999487437d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:16.067722 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5e9d737f-6496-407a-9873-6d999487437d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:16.165874 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-5e9d737f-6496-407a-9873-6d999487437d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:16.174014 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-5e9d737f-6496-407a-9873-6d999487437d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1" status: 200 len: 1193 microversion: 2.1 time: 0.121147 Jun 24 10:16:16.174608 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 549/1126] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:16 2022] GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1 => generated 1193 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:16:16.549513 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-977cda50-cf15-442a-ab66-0081cabd2f39 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:16.550586 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-977cda50-cf15-442a-ab66-0081cabd2f39 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:16.562752 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-977cda50-cf15-442a-ab66-0081cabd2f39 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:16.563450 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-977cda50-cf15-442a-ab66-0081cabd2f39 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:16.564889 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-977cda50-cf15-442a-ab66-0081cabd2f39 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:16.565659 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-977cda50-cf15-442a-ab66-0081cabd2f39 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:16.641122 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:16:16.641122 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Fri Jun 24 10:16:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 (ip 10.222.0.26) !!! Jun 24 10:16:16.699741 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-977cda50-cf15-442a-ab66-0081cabd2f39 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:16.699741 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-977cda50-cf15-442a-ab66-0081cabd2f39 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1383 microversion: 2.1 time: 0.138933 Jun 24 10:16:16.699741 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 578/1127] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:16 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1383 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:16.725149 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-68669cb9-c219-4964-94b9-6343d8309789 req-255561e8-4a9d-4909-b363-c435ca95af43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a43dc1-7e32-45bd-a007-1f9eb0fcedb3", "name": "network-vif-deleted", "tag": "27d385ce-eca4-4188-828a-5f898681a1fe"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:16:16.735009 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-68669cb9-c219-4964-94b9-6343d8309789 req-255561e8-4a9d-4909-b363-c435ca95af43 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:16.736278 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-68669cb9-c219-4964-94b9-6343d8309789 req-255561e8-4a9d-4909-b363-c435ca95af43 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:16.752696 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-68669cb9-c219-4964-94b9-6343d8309789 req-255561e8-4a9d-4909-b363-c435ca95af43 service nova] Creating event network-vif-deleted:27d385ce-eca4-4188-828a-5f898681a1fe for instance 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 on hv-cinder-84327 Jun 24 10:16:16.760452 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-68669cb9-c219-4964-94b9-6343d8309789 req-255561e8-4a9d-4909-b363-c435ca95af43 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039215 Jun 24 10:16:16.762052 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 550/1128] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:16:17.199861 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-78152a6f-d8df-4735-b5f2-14e7d311fc00 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:17.200847 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-78152a6f-d8df-4735-b5f2-14e7d311fc00 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 9c5d21f0-8a41-4c83-9c59-4233690febf1] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:17.214580 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-78152a6f-d8df-4735-b5f2-14e7d311fc00 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:17.215490 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-78152a6f-d8df-4735-b5f2-14e7d311fc00 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:17.216685 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-78152a6f-d8df-4735-b5f2-14e7d311fc00 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:17.217559 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-78152a6f-d8df-4735-b5f2-14e7d311fc00 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:17.306652 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-78152a6f-d8df-4735-b5f2-14e7d311fc00 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:17.314677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-78152a6f-d8df-4735-b5f2-14e7d311fc00 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1" status: 200 len: 1211 microversion: 2.1 time: 0.123320 Jun 24 10:16:17.315693 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 579/1129] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:17 2022] GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1 => generated 1211 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:17.703099 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-c6ebe918-8463-4e41-ac13-abaf59ea5e74 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:17.704573 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-c6ebe918-8463-4e41-ac13-abaf59ea5e74 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:17.711169 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c6ebe918-8463-4e41-ac13-abaf59ea5e74 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:17.712223 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c6ebe918-8463-4e41-ac13-abaf59ea5e74 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:17.713131 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c6ebe918-8463-4e41-ac13-abaf59ea5e74 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:17.713573 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c6ebe918-8463-4e41-ac13-abaf59ea5e74 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:17.751642 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c6ebe918-8463-4e41-ac13-abaf59ea5e74 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:17.752228 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c6ebe918-8463-4e41-ac13-abaf59ea5e74 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:17.753014 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.objects.instance [None req-c6ebe918-8463-4e41-ac13-abaf59ea5e74 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lazy-loading 'fault' on Instance uuid 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 {{(pid=124980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:16:18.193413 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-c6ebe918-8463-4e41-ac13-abaf59ea5e74 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ffa1ff356457ba454f5c0ebe69c23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3414c9d5fbfd4397a55c8d03eeb90a19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:18.203852 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-c6ebe918-8463-4e41-ac13-abaf59ea5e74 tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 200 len: 1225 microversion: 2.1 time: 0.506580 Jun 24 10:16:18.204818 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 551/1130] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:17 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 1225 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:18.332934 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-7e8eff45-de7f-457c-9da7-af6145b0eae6 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:18.333547 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-7e8eff45-de7f-457c-9da7-af6145b0eae6 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 9c5d21f0-8a41-4c83-9c59-4233690febf1] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:18.344397 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7e8eff45-de7f-457c-9da7-af6145b0eae6 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:18.345631 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7e8eff45-de7f-457c-9da7-af6145b0eae6 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:18.347007 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7e8eff45-de7f-457c-9da7-af6145b0eae6 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:18.348236 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7e8eff45-de7f-457c-9da7-af6145b0eae6 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:18.548089 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-7e8eff45-de7f-457c-9da7-af6145b0eae6 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:18.557786 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-7e8eff45-de7f-457c-9da7-af6145b0eae6 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1" status: 200 len: 1279 microversion: 2.1 time: 0.228932 Jun 24 10:16:18.558650 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 580/1131] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:18 2022] GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1 => generated 1279 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:19.225116 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-1255c769-b465-4ccd-be20-9aa5988a338f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:19.225771 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-1255c769-b465-4ccd-be20-9aa5988a338f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] [instance: 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:19.233096 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1255c769-b465-4ccd-be20-9aa5988a338f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:19.233819 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1255c769-b465-4ccd-be20-9aa5988a338f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:19.234590 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1255c769-b465-4ccd-be20-9aa5988a338f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:19.235025 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-1255c769-b465-4ccd-be20-9aa5988a338f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:19.253080 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.wsgi [None req-1255c769-b465-4ccd-be20-9aa5988a338f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] HTTP exception thrown: Instance 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 could not be found. Jun 24 10:16:19.254692 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-1255c769-b465-4ccd-be20-9aa5988a338f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Request method failure captured: Jun 24 10:16:19.254692 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: request: GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 HTTP/1.1 Jun 24 10:16:19.254692 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept: application/json Jun 24 10:16:19.254692 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept-Encoding: identity Jun 24 10:16:19.254692 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Connection: close Jun 24 10:16:19.254692 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Length: 0 Jun 24 10:16:19.254692 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Type: application/json Jun 24 10:16:19.254692 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Host: 10.222.0.26 Jun 24 10:16:19.254692 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Openstack-System-Scope: None Jun 24 10:16:19.254692 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: User-Agent: python-urllib3/1.26.9 Jun 24 10:16:19.254692 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Auth-Token: gAAAAABitY3PmXP5e9FFaHZ6wrTqYjSGwok-pRK8jp34TsWgHejDTsf_cMeFtjuRqMyTKQ7zyQteczHEa-wVDxcB2KabcEVJE6nLQm4SOY4knEb48Iw8gsZ6I1Ojh5NiB15p63ZYm4rDJ4LcHcP6vE-Y_Wtem_5cxsL16sjvZmi2CVaeVAlLR6U Jun 24 10:16:19.254692 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Id: None Jun 24 10:16:19.254692 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Name: None Jun 24 10:16:19.254692 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Identity-Status: Confirmed Jun 24 10:16:19.254692 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Is-Admin-Project: True Jun 24 10:16:19.254692 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Id: default Jun 24 10:16:19.254692 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Name: Default Jun 24 10:16:19.254692 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Id: 3414c9d5fbfd4397a55c8d03eeb90a19 Jun 24 10:16:19.254692 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Name: tempest-TestShelveInstance-440572029 Jun 24 10:16:19.254692 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Role: reader,member Jun 24 10:16:19.254692 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Roles: reader,member Jun 24 10:16:19.256520 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3414c9d5fbfd4397a55c8d03eeb90a19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3414c9d5fbfd4397a55c8d03eeb90a19", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3414c9d5fbfd4397a55c8d03eeb90a19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3414c9d5fbfd4397a55c8d03eeb90a19"}]}] Jun 24 10:16:19.256520 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant: tempest-TestShelveInstance-440572029 Jun 24 10:16:19.256520 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Id: 3414c9d5fbfd4397a55c8d03eeb90a19 Jun 24 10:16:19.256520 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Name: tempest-TestShelveInstance-440572029 Jun 24 10:16:19.256520 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User: tempest-TestShelveInstance-440572029-project Jun 24 10:16:19.256520 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Id: default Jun 24 10:16:19.256520 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Name: Default Jun 24 10:16:19.256520 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Id: 004ffa1ff356457ba454f5c0ebe69c23 Jun 24 10:16:19.256520 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Name: tempest-TestShelveInstance-440572029-project Jun 24 10:16:19.256520 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: method: > Jun 24 10:16:19.256520 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: exception: Instance 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 could not be found. Jun 24 10:16:19.256520 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: action_args: {'id': '82a43dc1-7e32-45bd-a007-1f9eb0fcedb3'} Jun 24 10:16:19.257602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:16:19.257602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:16:19.257602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:16:19.257602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:16:19.257602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:16:19.257602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:16:19.257602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:16:19.257602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:16:19.257602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:16:19.257602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:16:19.257602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 could not be found. Jun 24 10:16:19.257602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:16:19.257602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:16:19.257602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:16:19.257602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:16:19.257602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:16:19.257602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:16:19.257602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:16:19.257602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:16:19.257602 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:16:19.260421 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:16:19.260421 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:16:19.260421 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:16:19.260421 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:16:19.260421 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:16:19.260421 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:16:19.260421 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:16:19.260421 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 could not be found. Jun 24 10:16:19.260421 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:16:19.260421 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:16:19.260421 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:16:19.260421 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:16:19.260421 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:16:19.260421 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:16:19.260421 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:16:19.260421 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:16:19.260421 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 could not be found. Jun 24 10:16:19.260421 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:16:19.261959 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-1255c769-b465-4ccd-be20-9aa5988a338f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Returning 404 to user: Instance 82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 could not be found. {{(pid=124980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:16:19.261959 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-1255c769-b465-4ccd-be20-9aa5988a338f tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3" status: 404 len: 111 microversion: 2.1 time: 0.035774 Jun 24 10:16:19.261959 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 552/1132] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:19 2022] GET /compute/v2.1/servers/82a43dc1-7e32-45bd-a007-1f9eb0fcedb3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:16:19.373340 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-8ba29098-b888-4481-b7cb-9345a1539b2f req-d5f67685-a4fe-486e-b9c7-6a340d7582df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c5d21f0-8a41-4c83-9c59-4233690febf1", "tag": "8bdbb20d-d945-4771-9616-869e1f53ad73"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:16:19.384057 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-8ba29098-b888-4481-b7cb-9345a1539b2f req-d5f67685-a4fe-486e-b9c7-6a340d7582df service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:19.384549 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-8ba29098-b888-4481-b7cb-9345a1539b2f req-d5f67685-a4fe-486e-b9c7-6a340d7582df service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:19.403232 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-8ba29098-b888-4481-b7cb-9345a1539b2f req-d5f67685-a4fe-486e-b9c7-6a340d7582df service nova] Creating event network-changed:8bdbb20d-d945-4771-9616-869e1f53ad73 for instance 9c5d21f0-8a41-4c83-9c59-4233690febf1 on hv-cinder-84327 Jun 24 10:16:19.409420 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-8ba29098-b888-4481-b7cb-9345a1539b2f req-d5f67685-a4fe-486e-b9c7-6a340d7582df service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039992 Jun 24 10:16:19.410281 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 581/1133] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:16:19.578709 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-6038767e-1e33-410d-8174-1f60c75c2423 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:19.581169 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-6038767e-1e33-410d-8174-1f60c75c2423 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 9c5d21f0-8a41-4c83-9c59-4233690febf1] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:19.594900 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6038767e-1e33-410d-8174-1f60c75c2423 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:19.596159 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6038767e-1e33-410d-8174-1f60c75c2423 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:19.597745 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6038767e-1e33-410d-8174-1f60c75c2423 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:19.598837 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-6038767e-1e33-410d-8174-1f60c75c2423 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:19.659126 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-5ff25a94-84ab-4ca7-8ed7-4f7b33da044c tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] Calling method '.version_select at 0x7f0309801430>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:19.795571 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-5ff25a94-84ab-4ca7-8ed7-4f7b33da044c tempest-TestShelveInstance-440572029 tempest-TestShelveInstance-440572029-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1923491696" status: 202 len: 0 microversion: 2.1 time: 0.141102 Jun 24 10:16:19.797023 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 582/1134] 10.222.0.26 () {58 vars in 1253 bytes} [Fri Jun 24 10:16:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1923491696 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:16:19.933959 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-6038767e-1e33-410d-8174-1f60c75c2423 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:19.945543 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-6038767e-1e33-410d-8174-1f60c75c2423 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1" status: 200 len: 1267 microversion: 2.1 time: 0.370838 Jun 24 10:16:19.946926 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 553/1135] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:19 2022] GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1 => generated 1267 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:20.965514 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-734702f5-8d7f-40c4-ad3a-2bdca18ff548 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:20.967165 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-734702f5-8d7f-40c4-ad3a-2bdca18ff548 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 9c5d21f0-8a41-4c83-9c59-4233690febf1] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:20.973884 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-734702f5-8d7f-40c4-ad3a-2bdca18ff548 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:20.974441 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-734702f5-8d7f-40c4-ad3a-2bdca18ff548 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:20.975297 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-734702f5-8d7f-40c4-ad3a-2bdca18ff548 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:20.975805 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-734702f5-8d7f-40c4-ad3a-2bdca18ff548 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:21.200999 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-734702f5-8d7f-40c4-ad3a-2bdca18ff548 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:21.210218 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-734702f5-8d7f-40c4-ad3a-2bdca18ff548 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1" status: 200 len: 1267 microversion: 2.1 time: 0.249293 Jun 24 10:16:21.219784 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 583/1136] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:20 2022] GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1 => generated 1267 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:22.228170 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-cf8e5ba6-bb75-424c-9518-c5391b6d99f1 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:22.228866 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-cf8e5ba6-bb75-424c-9518-c5391b6d99f1 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 9c5d21f0-8a41-4c83-9c59-4233690febf1] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:22.232553 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell0:SELECT=2 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:16:22.233537 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell0:SELECT=6 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:16:22.237570 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-cf8e5ba6-bb75-424c-9518-c5391b6d99f1 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:22.239853 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-cf8e5ba6-bb75-424c-9518-c5391b6d99f1 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:22.239853 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-cf8e5ba6-bb75-424c-9518-c5391b6d99f1 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:22.239853 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-cf8e5ba6-bb75-424c-9518-c5391b6d99f1 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:22.397055 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-cf8e5ba6-bb75-424c-9518-c5391b6d99f1 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:22.405738 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-cf8e5ba6-bb75-424c-9518-c5391b6d99f1 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1" status: 200 len: 1267 microversion: 2.1 time: 0.182707 Jun 24 10:16:22.406469 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 554/1137] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:22 2022] GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:23.422952 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-cc584da4-61c1-46ef-b5e9-198c3446680e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:23.426278 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-cc584da4-61c1-46ef-b5e9-198c3446680e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 9c5d21f0-8a41-4c83-9c59-4233690febf1] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:23.426402 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell0:SELECT=2 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:16:23.432351 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-cc584da4-61c1-46ef-b5e9-198c3446680e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:23.432799 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-cc584da4-61c1-46ef-b5e9-198c3446680e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:23.433567 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-cc584da4-61c1-46ef-b5e9-198c3446680e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:23.433998 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-cc584da4-61c1-46ef-b5e9-198c3446680e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:23.608593 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-cc584da4-61c1-46ef-b5e9-198c3446680e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:23.630880 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-cc584da4-61c1-46ef-b5e9-198c3446680e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1" status: 200 len: 1267 microversion: 2.1 time: 0.211838 Jun 24 10:16:23.631494 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 584/1138] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:23 2022] GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1 => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:24.648298 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-00cca080-2be4-4eb0-acdc-1ecc51cdac13 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:24.649907 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-00cca080-2be4-4eb0-acdc-1ecc51cdac13 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 9c5d21f0-8a41-4c83-9c59-4233690febf1] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:24.656056 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-00cca080-2be4-4eb0-acdc-1ecc51cdac13 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:24.656569 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-00cca080-2be4-4eb0-acdc-1ecc51cdac13 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:24.657349 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-00cca080-2be4-4eb0-acdc-1ecc51cdac13 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:24.657788 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-00cca080-2be4-4eb0-acdc-1ecc51cdac13 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:24.819782 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-00cca080-2be4-4eb0-acdc-1ecc51cdac13 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:24.828063 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-00cca080-2be4-4eb0-acdc-1ecc51cdac13 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1" status: 200 len: 1267 microversion: 2.1 time: 0.183561 Jun 24 10:16:24.828680 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 555/1139] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:24 2022] GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1 => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:25.852319 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-55613791-f47e-423f-b945-30b1ee354f83 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:25.854560 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-55613791-f47e-423f-b945-30b1ee354f83 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 9c5d21f0-8a41-4c83-9c59-4233690febf1] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:25.865932 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-55613791-f47e-423f-b945-30b1ee354f83 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:25.867014 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-55613791-f47e-423f-b945-30b1ee354f83 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:25.868513 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-55613791-f47e-423f-b945-30b1ee354f83 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:25.869441 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-55613791-f47e-423f-b945-30b1ee354f83 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:26.101214 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-55613791-f47e-423f-b945-30b1ee354f83 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:26.110201 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-55613791-f47e-423f-b945-30b1ee354f83 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1" status: 200 len: 1267 microversion: 2.1 time: 0.265134 Jun 24 10:16:26.110875 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 585/1140] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:25 2022] GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1 => generated 1267 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:27.127326 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-b7c27f38-b2ed-4362-aaaf-dad2cb9a7694 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:27.128810 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-b7c27f38-b2ed-4362-aaaf-dad2cb9a7694 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 9c5d21f0-8a41-4c83-9c59-4233690febf1] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:27.136791 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b7c27f38-b2ed-4362-aaaf-dad2cb9a7694 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:27.137474 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b7c27f38-b2ed-4362-aaaf-dad2cb9a7694 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:27.138525 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b7c27f38-b2ed-4362-aaaf-dad2cb9a7694 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:27.139157 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-b7c27f38-b2ed-4362-aaaf-dad2cb9a7694 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:27.312584 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-b7c27f38-b2ed-4362-aaaf-dad2cb9a7694 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:27.321536 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-b7c27f38-b2ed-4362-aaaf-dad2cb9a7694 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1" status: 200 len: 1267 microversion: 2.1 time: 0.198208 Jun 24 10:16:27.322170 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 556/1141] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:27 2022] GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1 => generated 1267 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:28.338478 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-606a8678-8e36-47be-bd80-518561179a86 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:28.339350 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-606a8678-8e36-47be-bd80-518561179a86 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 9c5d21f0-8a41-4c83-9c59-4233690febf1] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:28.346644 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-606a8678-8e36-47be-bd80-518561179a86 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:28.346895 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-606a8678-8e36-47be-bd80-518561179a86 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:28.347690 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-606a8678-8e36-47be-bd80-518561179a86 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:28.348218 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-606a8678-8e36-47be-bd80-518561179a86 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:28.524445 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-606a8678-8e36-47be-bd80-518561179a86 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:28.532544 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-606a8678-8e36-47be-bd80-518561179a86 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1" status: 200 len: 1267 microversion: 2.1 time: 0.197951 Jun 24 10:16:28.533130 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 586/1142] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:28 2022] GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1 => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:29.550798 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-af49535c-418b-44dd-8aed-c1582f9604e7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:29.551405 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-af49535c-418b-44dd-8aed-c1582f9604e7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 9c5d21f0-8a41-4c83-9c59-4233690febf1] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:29.565971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-af49535c-418b-44dd-8aed-c1582f9604e7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:29.566422 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-af49535c-418b-44dd-8aed-c1582f9604e7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:29.567211 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-af49535c-418b-44dd-8aed-c1582f9604e7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:29.567706 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-af49535c-418b-44dd-8aed-c1582f9604e7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:29.720317 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-af49535c-418b-44dd-8aed-c1582f9604e7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:29.729449 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-af49535c-418b-44dd-8aed-c1582f9604e7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1" status: 200 len: 1267 microversion: 2.1 time: 0.182375 Jun 24 10:16:29.730055 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 557/1143] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:29 2022] GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:30.451943 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-8108656b-3dec-4f0b-b796-ae84c5cce489 req-ec038144-09e1-4186-8339-850ad4164278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c5d21f0-8a41-4c83-9c59-4233690febf1", "name": "network-vif-plugged", "status": "completed", "tag": "8bdbb20d-d945-4771-9616-869e1f53ad73"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:16:30.467247 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-8108656b-3dec-4f0b-b796-ae84c5cce489 req-ec038144-09e1-4186-8339-850ad4164278 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:30.468067 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-8108656b-3dec-4f0b-b796-ae84c5cce489 req-ec038144-09e1-4186-8339-850ad4164278 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:30.487167 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-8108656b-3dec-4f0b-b796-ae84c5cce489 req-ec038144-09e1-4186-8339-850ad4164278 service nova] Creating event network-vif-plugged:8bdbb20d-d945-4771-9616-869e1f53ad73 for instance 9c5d21f0-8a41-4c83-9c59-4233690febf1 on hv-cinder-84327 Jun 24 10:16:30.495399 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-8108656b-3dec-4f0b-b796-ae84c5cce489 req-ec038144-09e1-4186-8339-850ad4164278 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051787 Jun 24 10:16:30.496524 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 587/1144] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:16:30.747544 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-65fe233a-46ee-42a0-9124-bca40b2ec7a9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:30.748177 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-65fe233a-46ee-42a0-9124-bca40b2ec7a9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 9c5d21f0-8a41-4c83-9c59-4233690febf1] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:30.754843 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-65fe233a-46ee-42a0-9124-bca40b2ec7a9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:30.755274 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-65fe233a-46ee-42a0-9124-bca40b2ec7a9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:30.756033 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-65fe233a-46ee-42a0-9124-bca40b2ec7a9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:30.756495 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-65fe233a-46ee-42a0-9124-bca40b2ec7a9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:30.927596 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-65fe233a-46ee-42a0-9124-bca40b2ec7a9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:30.936188 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-65fe233a-46ee-42a0-9124-bca40b2ec7a9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1" status: 200 len: 1267 microversion: 2.1 time: 0.192509 Jun 24 10:16:30.936768 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 558/1145] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:30 2022] GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1 => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:31.955192 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-23c904aa-05cb-47b2-b329-976af7248f1a tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:31.955857 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-23c904aa-05cb-47b2-b329-976af7248f1a tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 9c5d21f0-8a41-4c83-9c59-4233690febf1] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:31.963300 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-23c904aa-05cb-47b2-b329-976af7248f1a tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:31.963749 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-23c904aa-05cb-47b2-b329-976af7248f1a tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:31.964551 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-23c904aa-05cb-47b2-b329-976af7248f1a tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:31.964995 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-23c904aa-05cb-47b2-b329-976af7248f1a tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:32.104554 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-23c904aa-05cb-47b2-b329-976af7248f1a tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:32.112695 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-23c904aa-05cb-47b2-b329-976af7248f1a tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1" status: 200 len: 1267 microversion: 2.1 time: 0.162377 Jun 24 10:16:32.113383 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 588/1146] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:31 2022] GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:33.129775 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-965b4778-7539-46c9-b024-d5a4a20d00fe tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:33.130428 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-965b4778-7539-46c9-b024-d5a4a20d00fe tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 9c5d21f0-8a41-4c83-9c59-4233690febf1] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:33.137022 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-965b4778-7539-46c9-b024-d5a4a20d00fe tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:33.137468 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-965b4778-7539-46c9-b024-d5a4a20d00fe tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:33.138229 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-965b4778-7539-46c9-b024-d5a4a20d00fe tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:33.138720 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-965b4778-7539-46c9-b024-d5a4a20d00fe tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:33.159541 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:16:33.279029 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-965b4778-7539-46c9-b024-d5a4a20d00fe tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:33.286483 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-965b4778-7539-46c9-b024-d5a4a20d00fe tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1" status: 200 len: 1454 microversion: 2.1 time: 0.160680 Jun 24 10:16:33.287048 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 559/1147] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:33 2022] GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1 => generated 1454 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:33.302885 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-a6ea260c-e6bc-4d9d-83e2-bae06ff0e4f2 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:33.303776 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-a6ea260c-e6bc-4d9d-83e2-bae06ff0e4f2 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 9c5d21f0-8a41-4c83-9c59-4233690febf1] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:33.310259 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a6ea260c-e6bc-4d9d-83e2-bae06ff0e4f2 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:33.310703 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a6ea260c-e6bc-4d9d-83e2-bae06ff0e4f2 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:33.311462 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a6ea260c-e6bc-4d9d-83e2-bae06ff0e4f2 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:33.311891 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-a6ea260c-e6bc-4d9d-83e2-bae06ff0e4f2 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:33.316008 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:16:33.447729 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-a6ea260c-e6bc-4d9d-83e2-bae06ff0e4f2 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:33.455312 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-a6ea260c-e6bc-4d9d-83e2-bae06ff0e4f2 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1" status: 200 len: 1454 microversion: 2.1 time: 0.156290 Jun 24 10:16:33.455879 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 589/1148] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:33 2022] GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1 => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:35.532633 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-1cbcce39-fec9-4d9e-8851-7cdc0f22b7d3 req-4745652d-f663-4372-b6e7-d0789dac0782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c5d21f0-8a41-4c83-9c59-4233690febf1", "tag": "8bdbb20d-d945-4771-9616-869e1f53ad73"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:16:35.542293 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-1cbcce39-fec9-4d9e-8851-7cdc0f22b7d3 req-4745652d-f663-4372-b6e7-d0789dac0782 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:35.542744 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-1cbcce39-fec9-4d9e-8851-7cdc0f22b7d3 req-4745652d-f663-4372-b6e7-d0789dac0782 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:35.555145 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-1cbcce39-fec9-4d9e-8851-7cdc0f22b7d3 req-4745652d-f663-4372-b6e7-d0789dac0782 service nova] Creating event network-changed:8bdbb20d-d945-4771-9616-869e1f53ad73 for instance 9c5d21f0-8a41-4c83-9c59-4233690febf1 on hv-cinder-84327 Jun 24 10:16:35.560289 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-1cbcce39-fec9-4d9e-8851-7cdc0f22b7d3 req-4745652d-f663-4372-b6e7-d0789dac0782 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032635 Jun 24 10:16:35.561242 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 560/1149] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:18:22.942043 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:22.943156 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=4 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:22.947178 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-155e7b96-156a-4b8b-9f09-bfbfb4ede8af tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1098280925", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1794596080", "security_groups": [{"name": "tempest-secgroup-smoke-1633595985"}], "block_device_mapping_v2": [{"uuid": "560d8654-f24f-4691-b6e7-c22fd492bf06", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7e0493cf-9922-46cd-9f38-42fd8c5fc022"}]}} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:18:23.082267 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.network.neutron [None req-155e7b96-156a-4b8b-9f09-bfbfb4ede8af tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] validate_networks() for [('7e0493cf-9922-46cd-9f38-42fd8c5fc022', None, None, None, None, None)] {{(pid=124979) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:18:23.467816 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-155e7b96-156a-4b8b-9f09-bfbfb4ede8af tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Flavor limits 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:18:23.468262 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-155e7b96-156a-4b8b-9f09-bfbfb4ede8af tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Image limits 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:18:23.468736 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-155e7b96-156a-4b8b-9f09-bfbfb4ede8af tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Flavor pref 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:18:23.469137 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-155e7b96-156a-4b8b-9f09-bfbfb4ede8af tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Image pref 0:0:0 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:18:23.469577 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.virt.hardware [None req-155e7b96-156a-4b8b-9f09-bfbfb4ede8af tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:18:23.483523 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-155e7b96-156a-4b8b-9f09-bfbfb4ede8af tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:23.483976 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-155e7b96-156a-4b8b-9f09-bfbfb4ede8af tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:23.485400 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-155e7b96-156a-4b8b-9f09-bfbfb4ede8af tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:23.485842 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-155e7b96-156a-4b8b-9f09-bfbfb4ede8af tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:23.504753 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-155e7b96-156a-4b8b-9f09-bfbfb4ede8af tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Getting quotas for project 2ea76e34ae2a4569851abd4e596b5e77. Resources: {'instances', 'cores', 'ram'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:18:23.508795 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.quota [None req-155e7b96-156a-4b8b-9f09-bfbfb4ede8af tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Getting quotas for user 40db8a50905141ffb83d84d83065952b and project 2ea76e34ae2a4569851abd4e596b5e77. Resources: {'instances', 'cores', 'ram'} {{(pid=124979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:18:23.565843 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-155e7b96-156a-4b8b-9f09-bfbfb4ede8af tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Going to run 1 instances... {{(pid=124979) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:18:23.567924 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-155e7b96-156a-4b8b-9f09-bfbfb4ede8af tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 90dffca8-2fc9-4942-b1bb-bdbc926bbae3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='560d8654-f24f-4691-b6e7-c22fd492bf06',volume_size=None,volume_type=None)] {{(pid=124979) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:18:23.988167 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-155e7b96-156a-4b8b-9f09-bfbfb4ede8af tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.047767 Jun 24 10:18:23.988837 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 590/1150] 10.222.0.26 () {60 vars in 1146 bytes} [Fri Jun 24 10:18:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:18:23.996753 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8649a2ff-946b-449a-9bb6-0e629be397e3] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 24 10:18:23.997573 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:24.002355 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-1ace4305-e971-490a-9580-8313233d4f28 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:24.003056 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-1ace4305-e971-490a-9580-8313233d4f28 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 90dffca8-2fc9-4942-b1bb-bdbc926bbae3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:24.059756 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-1ace4305-e971-490a-9580-8313233d4f28 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:24.066495 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-1ace4305-e971-490a-9580-8313233d4f28 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3" status: 200 len: 1095 microversion: 2.1 time: 0.071542 Jun 24 10:18:24.067069 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 561/1151] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:23 2022] GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:25.083908 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-ad40026d-5b22-46aa-88c8-6a685b413533 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:25.084842 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-ad40026d-5b22-46aa-88c8-6a685b413533 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 90dffca8-2fc9-4942-b1bb-bdbc926bbae3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:25.091777 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ad40026d-5b22-46aa-88c8-6a685b413533 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:25.092289 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ad40026d-5b22-46aa-88c8-6a685b413533 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:25.093079 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ad40026d-5b22-46aa-88c8-6a685b413533 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:25.093518 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-ad40026d-5b22-46aa-88c8-6a685b413533 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:25.164021 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-ad40026d-5b22-46aa-88c8-6a685b413533 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:25.173511 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-ad40026d-5b22-46aa-88c8-6a685b413533 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3" status: 200 len: 1145 microversion: 2.1 time: 0.093391 Jun 24 10:18:25.174093 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 591/1152] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:25 2022] GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3 => generated 1145 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:26.200326 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO oslo.messaging._drivers.impl_rabbit [-] [8649a2ff-946b-449a-9bb6-0e629be397e3] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 49486. Jun 24 10:18:26.319613 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-970dad0c-ee8a-47c5-bd0f-d8d196a37e15 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:26.327274 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-970dad0c-ee8a-47c5-bd0f-d8d196a37e15 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 90dffca8-2fc9-4942-b1bb-bdbc926bbae3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:26.327452 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-970dad0c-ee8a-47c5-bd0f-d8d196a37e15 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:26.327903 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-970dad0c-ee8a-47c5-bd0f-d8d196a37e15 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:26.328771 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-970dad0c-ee8a-47c5-bd0f-d8d196a37e15 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:26.329212 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-970dad0c-ee8a-47c5-bd0f-d8d196a37e15 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:26.423624 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-970dad0c-ee8a-47c5-bd0f-d8d196a37e15 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:26.432015 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-970dad0c-ee8a-47c5-bd0f-d8d196a37e15 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3" status: 200 len: 1201 microversion: 2.1 time: 0.244960 Jun 24 10:18:26.432702 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 562/1153] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:26 2022] GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3 => generated 1201 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:27.453151 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-e6b5b3de-fd20-43ce-a65f-68fc4e45c0b3 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:27.455000 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-e6b5b3de-fd20-43ce-a65f-68fc4e45c0b3 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 90dffca8-2fc9-4942-b1bb-bdbc926bbae3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:27.462363 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e6b5b3de-fd20-43ce-a65f-68fc4e45c0b3 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:27.473287 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e6b5b3de-fd20-43ce-a65f-68fc4e45c0b3 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:27.473287 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e6b5b3de-fd20-43ce-a65f-68fc4e45c0b3 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:27.473287 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-e6b5b3de-fd20-43ce-a65f-68fc4e45c0b3 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:27.631983 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-e6b5b3de-fd20-43ce-a65f-68fc4e45c0b3 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:27.642634 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-e6b5b3de-fd20-43ce-a65f-68fc4e45c0b3 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3" status: 200 len: 1279 microversion: 2.1 time: 0.193302 Jun 24 10:18:27.651040 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 592/1154] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:27 2022] GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3 => generated 1279 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:28.502484 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-a7549bb4-3c16-4301-833c-8944fabe7255 req-cf60a9db-c870-43b4-aec7-901c96b6098d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90dffca8-2fc9-4942-b1bb-bdbc926bbae3", "tag": "b5a5bf8f-1814-429f-b1bd-001451b32294"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:18:28.511090 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-a7549bb4-3c16-4301-833c-8944fabe7255 req-cf60a9db-c870-43b4-aec7-901c96b6098d service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:28.511547 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-a7549bb4-3c16-4301-833c-8944fabe7255 req-cf60a9db-c870-43b4-aec7-901c96b6098d service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:28.523308 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-a7549bb4-3c16-4301-833c-8944fabe7255 req-cf60a9db-c870-43b4-aec7-901c96b6098d service nova] Creating event network-changed:b5a5bf8f-1814-429f-b1bd-001451b32294 for instance 90dffca8-2fc9-4942-b1bb-bdbc926bbae3 on hv-cinder-84327 Jun 24 10:18:28.528802 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-a7549bb4-3c16-4301-833c-8944fabe7255 req-cf60a9db-c870-43b4-aec7-901c96b6098d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110963 Jun 24 10:18:28.529417 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 563/1155] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:18:28.666816 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-9a2a0a61-ef43-45b1-8f05-181bb8e4d101 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:28.667385 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-9a2a0a61-ef43-45b1-8f05-181bb8e4d101 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 90dffca8-2fc9-4942-b1bb-bdbc926bbae3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:28.676069 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9a2a0a61-ef43-45b1-8f05-181bb8e4d101 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:28.676594 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9a2a0a61-ef43-45b1-8f05-181bb8e4d101 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:28.677640 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9a2a0a61-ef43-45b1-8f05-181bb8e4d101 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:28.678498 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-9a2a0a61-ef43-45b1-8f05-181bb8e4d101 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:28.819305 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-9a2a0a61-ef43-45b1-8f05-181bb8e4d101 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:28.827157 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-9a2a0a61-ef43-45b1-8f05-181bb8e4d101 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3" status: 200 len: 1267 microversion: 2.1 time: 0.164682 Jun 24 10:18:28.827680 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 593/1156] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:28 2022] GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:29.846228 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-2c519883-6a9f-43fd-ab43-71ea0254bfa2 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:29.846951 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-2c519883-6a9f-43fd-ab43-71ea0254bfa2 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 90dffca8-2fc9-4942-b1bb-bdbc926bbae3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:29.853270 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2c519883-6a9f-43fd-ab43-71ea0254bfa2 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:29.853734 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2c519883-6a9f-43fd-ab43-71ea0254bfa2 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:29.854515 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2c519883-6a9f-43fd-ab43-71ea0254bfa2 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:29.854956 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-2c519883-6a9f-43fd-ab43-71ea0254bfa2 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:30.023971 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-2c519883-6a9f-43fd-ab43-71ea0254bfa2 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:30.031901 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-2c519883-6a9f-43fd-ab43-71ea0254bfa2 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3" status: 200 len: 1267 microversion: 2.1 time: 0.190493 Jun 24 10:18:30.032594 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 564/1157] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:29 2022] GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3 => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:31.047983 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-fb572bdd-ac58-4e88-a638-a5e55b86cd5a tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:31.048728 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-fb572bdd-ac58-4e88-a638-a5e55b86cd5a tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 90dffca8-2fc9-4942-b1bb-bdbc926bbae3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:31.055653 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fb572bdd-ac58-4e88-a638-a5e55b86cd5a tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:31.056091 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fb572bdd-ac58-4e88-a638-a5e55b86cd5a tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:31.056885 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fb572bdd-ac58-4e88-a638-a5e55b86cd5a tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:31.057311 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fb572bdd-ac58-4e88-a638-a5e55b86cd5a tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:31.200142 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-fb572bdd-ac58-4e88-a638-a5e55b86cd5a tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:31.205880 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-fb572bdd-ac58-4e88-a638-a5e55b86cd5a tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3" status: 200 len: 1267 microversion: 2.1 time: 0.161700 Jun 24 10:18:31.206513 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 594/1158] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:31 2022] GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:32.222824 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-c403204e-0632-4c61-8853-9e4e06134eb7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:32.223429 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-c403204e-0632-4c61-8853-9e4e06134eb7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 90dffca8-2fc9-4942-b1bb-bdbc926bbae3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:32.230260 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c403204e-0632-4c61-8853-9e4e06134eb7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:32.230717 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c403204e-0632-4c61-8853-9e4e06134eb7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:32.231507 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c403204e-0632-4c61-8853-9e4e06134eb7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:32.231947 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-c403204e-0632-4c61-8853-9e4e06134eb7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:32.367223 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-c403204e-0632-4c61-8853-9e4e06134eb7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:32.374881 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-c403204e-0632-4c61-8853-9e4e06134eb7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3" status: 200 len: 1267 microversion: 2.1 time: 0.155900 Jun 24 10:18:32.375565 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 565/1159] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:32 2022] GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:18:33.394669 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-2d82a428-d801-4350-9a07-5aa45e20d343 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:33.395617 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-2d82a428-d801-4350-9a07-5aa45e20d343 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 90dffca8-2fc9-4942-b1bb-bdbc926bbae3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:33.405572 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2d82a428-d801-4350-9a07-5aa45e20d343 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:33.406068 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2d82a428-d801-4350-9a07-5aa45e20d343 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:33.407072 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2d82a428-d801-4350-9a07-5aa45e20d343 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:33.407581 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-2d82a428-d801-4350-9a07-5aa45e20d343 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:33.493633 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell0:SELECT=2 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:33.515456 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell0:SELECT=6 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:33.572829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-2d82a428-d801-4350-9a07-5aa45e20d343 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:33.582690 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-2d82a428-d801-4350-9a07-5aa45e20d343 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3" status: 200 len: 1267 microversion: 2.1 time: 0.194244 Jun 24 10:18:33.583287 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 595/1160] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:33 2022] GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3 => generated 1267 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:34.603407 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-45f9226a-1cb6-45e7-bf89-f971d216c5e6 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:34.604368 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-45f9226a-1cb6-45e7-bf89-f971d216c5e6 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 90dffca8-2fc9-4942-b1bb-bdbc926bbae3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:34.606498 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell0:SELECT=2 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:34.611837 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-45f9226a-1cb6-45e7-bf89-f971d216c5e6 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:34.612345 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-45f9226a-1cb6-45e7-bf89-f971d216c5e6 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:34.613123 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-45f9226a-1cb6-45e7-bf89-f971d216c5e6 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:34.613556 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-45f9226a-1cb6-45e7-bf89-f971d216c5e6 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:34.795358 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-45f9226a-1cb6-45e7-bf89-f971d216c5e6 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:34.809567 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-45f9226a-1cb6-45e7-bf89-f971d216c5e6 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3" status: 200 len: 1267 microversion: 2.1 time: 0.209584 Jun 24 10:18:34.810482 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 566/1161] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:34 2022] GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3 => generated 1267 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:18:35.829980 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-65036568-48d0-40cc-8d01-57ebf030dd49 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:35.830640 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-65036568-48d0-40cc-8d01-57ebf030dd49 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 90dffca8-2fc9-4942-b1bb-bdbc926bbae3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:35.837664 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-65036568-48d0-40cc-8d01-57ebf030dd49 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:35.838119 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-65036568-48d0-40cc-8d01-57ebf030dd49 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:35.839180 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-65036568-48d0-40cc-8d01-57ebf030dd49 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:35.839436 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-65036568-48d0-40cc-8d01-57ebf030dd49 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:35.987503 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-65036568-48d0-40cc-8d01-57ebf030dd49 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:35.995914 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-65036568-48d0-40cc-8d01-57ebf030dd49 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3" status: 200 len: 1267 microversion: 2.1 time: 0.169703 Jun 24 10:18:35.996341 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 596/1162] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:35 2022] GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:37.014586 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-bb7a0da5-2b5a-4381-99cf-7359a9e2b037 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:37.015211 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-bb7a0da5-2b5a-4381-99cf-7359a9e2b037 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 90dffca8-2fc9-4942-b1bb-bdbc926bbae3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:37.022219 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-bb7a0da5-2b5a-4381-99cf-7359a9e2b037 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:37.028318 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-bb7a0da5-2b5a-4381-99cf-7359a9e2b037 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:37.028318 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-bb7a0da5-2b5a-4381-99cf-7359a9e2b037 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:37.028318 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-bb7a0da5-2b5a-4381-99cf-7359a9e2b037 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:37.179740 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-bb7a0da5-2b5a-4381-99cf-7359a9e2b037 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:37.194045 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-bb7a0da5-2b5a-4381-99cf-7359a9e2b037 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3" status: 200 len: 1267 microversion: 2.1 time: 0.183054 Jun 24 10:18:37.207102 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 567/1163] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:37 2022] GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3 => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:38.218829 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-0dbdc70a-c4c9-4e5b-8532-ef4b21fafe2b tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:38.219462 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-0dbdc70a-c4c9-4e5b-8532-ef4b21fafe2b tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 90dffca8-2fc9-4942-b1bb-bdbc926bbae3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:38.234162 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0dbdc70a-c4c9-4e5b-8532-ef4b21fafe2b tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:38.238871 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0dbdc70a-c4c9-4e5b-8532-ef4b21fafe2b tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:38.238871 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0dbdc70a-c4c9-4e5b-8532-ef4b21fafe2b tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:38.238871 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-0dbdc70a-c4c9-4e5b-8532-ef4b21fafe2b tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:38.384279 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-0dbdc70a-c4c9-4e5b-8532-ef4b21fafe2b tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:38.393311 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-0dbdc70a-c4c9-4e5b-8532-ef4b21fafe2b tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3" status: 200 len: 1267 microversion: 2.1 time: 0.178313 Jun 24 10:18:38.393886 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 597/1164] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:38 2022] GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:18:39.210853 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-afd3e72a-37f9-45b9-87a2-37dceed89f3e req-62d3c473-18fd-47b9-812a-280a78f0ba35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90dffca8-2fc9-4942-b1bb-bdbc926bbae3", "name": "network-vif-plugged", "status": "completed", "tag": "b5a5bf8f-1814-429f-b1bd-001451b32294"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:18:39.219264 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-afd3e72a-37f9-45b9-87a2-37dceed89f3e req-62d3c473-18fd-47b9-812a-280a78f0ba35 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:39.219771 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-afd3e72a-37f9-45b9-87a2-37dceed89f3e req-62d3c473-18fd-47b9-812a-280a78f0ba35 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:39.231469 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-afd3e72a-37f9-45b9-87a2-37dceed89f3e req-62d3c473-18fd-47b9-812a-280a78f0ba35 service nova] Creating event network-vif-plugged:b5a5bf8f-1814-429f-b1bd-001451b32294 for instance 90dffca8-2fc9-4942-b1bb-bdbc926bbae3 on hv-cinder-84327 Jun 24 10:18:39.237568 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-afd3e72a-37f9-45b9-87a2-37dceed89f3e req-62d3c473-18fd-47b9-812a-280a78f0ba35 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101429 Jun 24 10:18:39.238402 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 568/1165] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:18:39.417807 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-007a1ff5-ee7e-4b7a-9483-16a32875f33d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:39.418489 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-007a1ff5-ee7e-4b7a-9483-16a32875f33d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 90dffca8-2fc9-4942-b1bb-bdbc926bbae3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:39.425550 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-007a1ff5-ee7e-4b7a-9483-16a32875f33d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:39.426006 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-007a1ff5-ee7e-4b7a-9483-16a32875f33d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:39.426820 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-007a1ff5-ee7e-4b7a-9483-16a32875f33d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:39.427423 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-007a1ff5-ee7e-4b7a-9483-16a32875f33d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:39.590694 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-007a1ff5-ee7e-4b7a-9483-16a32875f33d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:39.604387 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-007a1ff5-ee7e-4b7a-9483-16a32875f33d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3" status: 200 len: 1267 microversion: 2.1 time: 0.191780 Jun 24 10:18:39.605487 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 598/1166] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:39 2022] GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3 => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:40.629899 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-d834e32d-6a91-4e86-b0b9-1403dff7b89a tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:40.630598 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-d834e32d-6a91-4e86-b0b9-1403dff7b89a tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 90dffca8-2fc9-4942-b1bb-bdbc926bbae3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:40.636990 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d834e32d-6a91-4e86-b0b9-1403dff7b89a tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:40.637453 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d834e32d-6a91-4e86-b0b9-1403dff7b89a tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:40.638220 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d834e32d-6a91-4e86-b0b9-1403dff7b89a tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:40.638654 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-d834e32d-6a91-4e86-b0b9-1403dff7b89a tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:40.776073 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-d834e32d-6a91-4e86-b0b9-1403dff7b89a tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:40.783536 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-d834e32d-6a91-4e86-b0b9-1403dff7b89a tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3" status: 200 len: 1267 microversion: 2.1 time: 0.159080 Jun 24 10:18:40.784249 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 569/1167] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:40 2022] GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:41.801758 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-12700ec9-2620-4eaa-bbb5-26c7871622b9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:41.802386 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-12700ec9-2620-4eaa-bbb5-26c7871622b9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 90dffca8-2fc9-4942-b1bb-bdbc926bbae3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:41.809456 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-12700ec9-2620-4eaa-bbb5-26c7871622b9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:41.809904 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-12700ec9-2620-4eaa-bbb5-26c7871622b9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:41.810694 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-12700ec9-2620-4eaa-bbb5-26c7871622b9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:41.811136 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-12700ec9-2620-4eaa-bbb5-26c7871622b9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:41.949134 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-12700ec9-2620-4eaa-bbb5-26c7871622b9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:41.957048 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-12700ec9-2620-4eaa-bbb5-26c7871622b9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3" status: 200 len: 1454 microversion: 2.1 time: 0.159977 Jun 24 10:18:41.957704 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 599/1168] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:41 2022] GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3 => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:41.974386 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-00660529-f3b1-42c6-b054-68713d43e8b7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:41.975005 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-00660529-f3b1-42c6-b054-68713d43e8b7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 90dffca8-2fc9-4942-b1bb-bdbc926bbae3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:41.981745 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-00660529-f3b1-42c6-b054-68713d43e8b7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:41.982229 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-00660529-f3b1-42c6-b054-68713d43e8b7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:41.983032 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-00660529-f3b1-42c6-b054-68713d43e8b7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:41.983522 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-00660529-f3b1-42c6-b054-68713d43e8b7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:42.121111 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-00660529-f3b1-42c6-b054-68713d43e8b7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:42.133924 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-00660529-f3b1-42c6-b054-68713d43e8b7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3" status: 200 len: 1454 microversion: 2.1 time: 0.163049 Jun 24 10:18:42.135410 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 570/1169] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:41 2022] GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3 => generated 1454 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:44.197856 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-c38e5c81-7907-40a5-b83c-a7e02c8f2471 req-dfe3c885-661a-491f-a86f-2149a2ed167a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90dffca8-2fc9-4942-b1bb-bdbc926bbae3", "tag": "b5a5bf8f-1814-429f-b1bd-001451b32294"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:18:44.206301 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-c38e5c81-7907-40a5-b83c-a7e02c8f2471 req-dfe3c885-661a-491f-a86f-2149a2ed167a service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:44.206774 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-c38e5c81-7907-40a5-b83c-a7e02c8f2471 req-dfe3c885-661a-491f-a86f-2149a2ed167a service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:44.218530 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-c38e5c81-7907-40a5-b83c-a7e02c8f2471 req-dfe3c885-661a-491f-a86f-2149a2ed167a service nova] Creating event network-changed:b5a5bf8f-1814-429f-b1bd-001451b32294 for instance 90dffca8-2fc9-4942-b1bb-bdbc926bbae3 on hv-cinder-84327 Jun 24 10:18:44.225053 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-c38e5c81-7907-40a5-b83c-a7e02c8f2471 req-dfe3c885-661a-491f-a86f-2149a2ed167a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093533 Jun 24 10:18:44.225675 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 600/1170] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:19:28.149648 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:19:28.150263 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Fri Jun 24 10:19:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:19:28.588646 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:19:28.589170 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Fri Jun 24 10:19:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:20:24.136033 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_api:SELECT=22 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:24.136814 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG dbcounter [-] [124980] Writing DB stats nova_cell1:SELECT=50 {{(pid=124980) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:24.139139 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR oslo.messaging._drivers.impl_rabbit [-] [bc8eaeca-9dd9-49de-aab8-85c5b9acfbec] AMQP server on 10.222.0.26:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jun 24 10:20:24.139828 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:24.140656 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG dbcounter [-] [124979] Writing DB stats nova_cell1:SELECT=58 {{(pid=124979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:24.142605 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-a569ff18-a294-40a1-8b16-82fe39a5fc4f tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:24.143126 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-a569ff18-a294-40a1-8b16-82fe39a5fc4f tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 90dffca8-2fc9-4942-b1bb-bdbc926bbae3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:24.145262 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-ae24942c-8482-4e4e-892a-787390d8e47a req-d93bf135-7970-44cc-83de-967129943d75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90dffca8-2fc9-4942-b1bb-bdbc926bbae3", "tag": "b5a5bf8f-1814-429f-b1bd-001451b32294"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:20:24.150618 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a569ff18-a294-40a1-8b16-82fe39a5fc4f tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:24.151069 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a569ff18-a294-40a1-8b16-82fe39a5fc4f tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:24.152240 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a569ff18-a294-40a1-8b16-82fe39a5fc4f tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:24.152711 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-a569ff18-a294-40a1-8b16-82fe39a5fc4f tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:24.154853 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-ae24942c-8482-4e4e-892a-787390d8e47a req-d93bf135-7970-44cc-83de-967129943d75 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:24.155349 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-ae24942c-8482-4e4e-892a-787390d8e47a req-d93bf135-7970-44cc-83de-967129943d75 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:24.167092 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-ae24942c-8482-4e4e-892a-787390d8e47a req-d93bf135-7970-44cc-83de-967129943d75 service nova] Creating event network-changed:b5a5bf8f-1814-429f-b1bd-001451b32294 for instance 90dffca8-2fc9-4942-b1bb-bdbc926bbae3 on hv-cinder-84327 Jun 24 10:20:24.172303 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-ae24942c-8482-4e4e-892a-787390d8e47a req-d93bf135-7970-44cc-83de-967129943d75 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035266 Jun 24 10:20:24.173113 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 601/1171] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:20:24.192033 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-a569ff18-a294-40a1-8b16-82fe39a5fc4f tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 90dffca8-2fc9-4942-b1bb-bdbc926bbae3] Going to try to terminate instance {{(pid=124980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:20:24.497226 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-a569ff18-a294-40a1-8b16-82fe39a5fc4f tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "DELETE /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3" status: 204 len: 0 microversion: 2.1 time: 0.362508 Jun 24 10:20:24.498365 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 571/1172] 10.222.0.26 () {58 vars in 1238 bytes} [Fri Jun 24 10:20:24 2022] DELETE /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:20:24.508698 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-7a7d7b96-d10d-4e99-ba7c-3ba3a75fae3b tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:24.509420 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-7a7d7b96-d10d-4e99-ba7c-3ba3a75fae3b tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 90dffca8-2fc9-4942-b1bb-bdbc926bbae3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:24.517657 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7a7d7b96-d10d-4e99-ba7c-3ba3a75fae3b tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:24.518106 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7a7d7b96-d10d-4e99-ba7c-3ba3a75fae3b tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:24.518881 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7a7d7b96-d10d-4e99-ba7c-3ba3a75fae3b tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:24.519311 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-7a7d7b96-d10d-4e99-ba7c-3ba3a75fae3b tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:24.686312 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-7a7d7b96-d10d-4e99-ba7c-3ba3a75fae3b tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:24.694350 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-7a7d7b96-d10d-4e99-ba7c-3ba3a75fae3b tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3" status: 200 len: 1578 microversion: 2.1 time: 0.191449 Jun 24 10:20:24.694941 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 602/1173] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:24 2022] GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3 => generated 1578 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:25.712652 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-71de816f-33cd-418e-90a2-14d5ecee823d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:25.713348 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-71de816f-33cd-418e-90a2-14d5ecee823d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 90dffca8-2fc9-4942-b1bb-bdbc926bbae3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:25.720371 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-71de816f-33cd-418e-90a2-14d5ecee823d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:25.720820 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-71de816f-33cd-418e-90a2-14d5ecee823d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:25.721591 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-71de816f-33cd-418e-90a2-14d5ecee823d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:25.722022 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-71de816f-33cd-418e-90a2-14d5ecee823d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:25.938131 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-71de816f-33cd-418e-90a2-14d5ecee823d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:25.940757 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-71de816f-33cd-418e-90a2-14d5ecee823d tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3" status: 200 len: 1578 microversion: 2.1 time: 0.232906 Jun 24 10:20:25.941324 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 572/1174] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:25 2022] GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3 => generated 1578 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:26.960417 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-6eb6b43a-82ab-44cf-a7ed-5fd9faceef16 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:26.961134 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-6eb6b43a-82ab-44cf-a7ed-5fd9faceef16 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 90dffca8-2fc9-4942-b1bb-bdbc926bbae3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:26.973798 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6eb6b43a-82ab-44cf-a7ed-5fd9faceef16 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:26.973798 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6eb6b43a-82ab-44cf-a7ed-5fd9faceef16 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:26.973798 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6eb6b43a-82ab-44cf-a7ed-5fd9faceef16 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:26.973798 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6eb6b43a-82ab-44cf-a7ed-5fd9faceef16 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:26.997053 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO oslo.messaging._drivers.impl_rabbit [-] [bc8eaeca-9dd9-49de-aab8-85c5b9acfbec] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 49576. Jun 24 10:20:27.005465 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [req-215c28fb-8e4f-4c5e-9440-945c8d079c3a req-dd4c8f28-a6dd-4655-8aeb-64fd3bee82c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90dffca8-2fc9-4942-b1bb-bdbc926bbae3", "name": "network-vif-deleted", "tag": "b5a5bf8f-1814-429f-b1bd-001451b32294"}]} {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:20:27.013909 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-215c28fb-8e4f-4c5e-9440-945c8d079c3a req-dd4c8f28-a6dd-4655-8aeb-64fd3bee82c3 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:27.014362 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [req-215c28fb-8e4f-4c5e-9440-945c8d079c3a req-dd4c8f28-a6dd-4655-8aeb-64fd3bee82c3 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:27.025797 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.compute.server_external_events [req-215c28fb-8e4f-4c5e-9440-945c8d079c3a req-dd4c8f28-a6dd-4655-8aeb-64fd3bee82c3 service nova] Creating event network-vif-deleted:b5a5bf8f-1814-429f-b1bd-001451b32294 for instance 90dffca8-2fc9-4942-b1bb-bdbc926bbae3 on hv-cinder-84327 Jun 24 10:20:27.031242 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [req-215c28fb-8e4f-4c5e-9440-945c8d079c3a req-dd4c8f28-a6dd-4655-8aeb-64fd3bee82c3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029394 Jun 24 10:20:27.032022 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 573/1175] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:20:27.053793 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-6eb6b43a-82ab-44cf-a7ed-5fd9faceef16 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:27.059032 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-6eb6b43a-82ab-44cf-a7ed-5fd9faceef16 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3" status: 200 len: 1392 microversion: 2.1 time: 0.103876 Jun 24 10:20:27.059599 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 603/1176] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:26 2022] GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3 => generated 1392 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:28.077476 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-5222b6d1-a322-4839-acd6-db6373b53355 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:28.078188 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-5222b6d1-a322-4839-acd6-db6373b53355 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 90dffca8-2fc9-4942-b1bb-bdbc926bbae3] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:28.084841 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5222b6d1-a322-4839-acd6-db6373b53355 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:28.085280 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5222b6d1-a322-4839-acd6-db6373b53355 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:28.086055 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5222b6d1-a322-4839-acd6-db6373b53355 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:28.086500 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5222b6d1-a322-4839-acd6-db6373b53355 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:28.119745 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5222b6d1-a322-4839-acd6-db6373b53355 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:28.120231 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-5222b6d1-a322-4839-acd6-db6373b53355 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:28.120690 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.objects.instance [None req-5222b6d1-a322-4839-acd6-db6373b53355 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lazy-loading 'fault' on Instance uuid 90dffca8-2fc9-4942-b1bb-bdbc926bbae3 {{(pid=124980) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:20:28.162659 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-5222b6d1-a322-4839-acd6-db6373b53355 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:28.170466 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-5222b6d1-a322-4839-acd6-db6373b53355 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3" status: 200 len: 1231 microversion: 2.1 time: 0.097685 Jun 24 10:20:28.171040 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 574/1177] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:28 2022] GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3 => generated 1231 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:29.187915 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-84b947c9-6d24-45ce-a6bc-dfe2020fb18e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:29.188570 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-84b947c9-6d24-45ce-a6bc-dfe2020fb18e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 90dffca8-2fc9-4942-b1bb-bdbc926bbae3] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:29.195679 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-84b947c9-6d24-45ce-a6bc-dfe2020fb18e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:29.196186 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-84b947c9-6d24-45ce-a6bc-dfe2020fb18e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:29.197019 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-84b947c9-6d24-45ce-a6bc-dfe2020fb18e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:29.197457 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-84b947c9-6d24-45ce-a6bc-dfe2020fb18e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:29.211765 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-84b947c9-6d24-45ce-a6bc-dfe2020fb18e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] HTTP exception thrown: Instance 90dffca8-2fc9-4942-b1bb-bdbc926bbae3 could not be found. Jun 24 10:20:29.213497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-84b947c9-6d24-45ce-a6bc-dfe2020fb18e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Request method failure captured: Jun 24 10:20:29.213497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3 HTTP/1.1 Jun 24 10:20:29.213497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:20:29.213497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:20:29.213497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:20:29.213497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 0 Jun 24 10:20:29.213497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:20:29.213497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:20:29.213497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:20:29.213497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:20:29.213497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitY4-mZzxoWEv_LI9TYi1AzdmQ7G-PR0BrmJqvZvKXoIalr0MomVzZ-fihaxe0TZ7uOZcJ55kBNa-DKOp71AdPyugpp77X6EbAX2vKGVnsRuWX9n53vPkBOoNKbXKbXWr9T75Md29KBwnYNhIGaO9sd3edR5iuLrDrQRn8ojNSsEJCmU Jun 24 10:20:29.213497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:20:29.213497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:20:29.213497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:20:29.213497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:20:29.213497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:20:29.213497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:20:29.213497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: 2ea76e34ae2a4569851abd4e596b5e77 Jun 24 10:20:29.213497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-TestVolumeBootPattern-1176966912 Jun 24 10:20:29.213497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:20:29.213497 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:20:29.215445 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2ea76e34ae2a4569851abd4e596b5e77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2ea76e34ae2a4569851abd4e596b5e77", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2ea76e34ae2a4569851abd4e596b5e77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2ea76e34ae2a4569851abd4e596b5e77"}]}] Jun 24 10:20:29.215445 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-TestVolumeBootPattern-1176966912 Jun 24 10:20:29.215445 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: 2ea76e34ae2a4569851abd4e596b5e77 Jun 24 10:20:29.215445 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-TestVolumeBootPattern-1176966912 Jun 24 10:20:29.215445 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-TestVolumeBootPattern-1176966912-project Jun 24 10:20:29.215445 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:20:29.215445 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:20:29.215445 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: 40db8a50905141ffb83d84d83065952b Jun 24 10:20:29.215445 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-TestVolumeBootPattern-1176966912-project Jun 24 10:20:29.215445 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: > Jun 24 10:20:29.215445 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Instance 90dffca8-2fc9-4942-b1bb-bdbc926bbae3 could not be found. Jun 24 10:20:29.215445 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'id': '90dffca8-2fc9-4942-b1bb-bdbc926bbae3'} Jun 24 10:20:29.216421 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:20:29.216421 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:20:29.216421 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:20:29.216421 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:20:29.216421 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:20:29.216421 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:20:29.216421 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:20:29.216421 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:20:29.216421 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:20:29.216421 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:20:29.216421 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90dffca8-2fc9-4942-b1bb-bdbc926bbae3 could not be found. Jun 24 10:20:29.216421 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:20:29.216421 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:20:29.216421 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:20:29.216421 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:20:29.216421 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:20:29.216421 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:20:29.216421 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:20:29.216421 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:20:29.216421 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:20:29.218012 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:20:29.218012 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:20:29.218012 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:20:29.218012 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:20:29.218012 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:20:29.218012 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:20:29.218012 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:20:29.218012 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90dffca8-2fc9-4942-b1bb-bdbc926bbae3 could not be found. Jun 24 10:20:29.218012 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:20:29.218012 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:20:29.218012 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:20:29.218012 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:20:29.218012 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:20:29.218012 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:20:29.218012 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:20:29.218012 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:20:29.218012 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90dffca8-2fc9-4942-b1bb-bdbc926bbae3 could not be found. Jun 24 10:20:29.218012 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:20:29.219419 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-84b947c9-6d24-45ce-a6bc-dfe2020fb18e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Returning 404 to user: Instance 90dffca8-2fc9-4942-b1bb-bdbc926bbae3 could not be found. {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:20:29.219419 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-84b947c9-6d24-45ce-a6bc-dfe2020fb18e tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3" status: 404 len: 111 microversion: 2.1 time: 0.030966 Jun 24 10:20:29.219419 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 604/1178] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:29 2022] GET /compute/v2.1/servers/90dffca8-2fc9-4942-b1bb-bdbc926bbae3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:20:32.547375 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-3101c95d-3bfd-4b34-94fd-f701c371879c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:32.547924 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-3101c95d-3bfd-4b34-94fd-f701c371879c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 9c5d21f0-8a41-4c83-9c59-4233690febf1] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:32.549472 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-5884aecb-3323-4f57-b645-d60d40911b8f req-99b83730-f660-47dd-a23d-2e6e2cd3b131 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c5d21f0-8a41-4c83-9c59-4233690febf1", "tag": "8bdbb20d-d945-4771-9616-869e1f53ad73"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:20:32.554839 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3101c95d-3bfd-4b34-94fd-f701c371879c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:32.555353 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3101c95d-3bfd-4b34-94fd-f701c371879c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:32.556357 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3101c95d-3bfd-4b34-94fd-f701c371879c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:32.556806 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-3101c95d-3bfd-4b34-94fd-f701c371879c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:32.559455 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-5884aecb-3323-4f57-b645-d60d40911b8f req-99b83730-f660-47dd-a23d-2e6e2cd3b131 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:32.559896 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-5884aecb-3323-4f57-b645-d60d40911b8f req-99b83730-f660-47dd-a23d-2e6e2cd3b131 service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:32.571270 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-5884aecb-3323-4f57-b645-d60d40911b8f req-99b83730-f660-47dd-a23d-2e6e2cd3b131 service nova] Creating event network-changed:8bdbb20d-d945-4771-9616-869e1f53ad73 for instance 9c5d21f0-8a41-4c83-9c59-4233690febf1 on hv-cinder-84327 Jun 24 10:20:32.576529 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-5884aecb-3323-4f57-b645-d60d40911b8f req-99b83730-f660-47dd-a23d-2e6e2cd3b131 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030584 Jun 24 10:20:32.577121 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 605/1179] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:20:32.585377 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-3101c95d-3bfd-4b34-94fd-f701c371879c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 9c5d21f0-8a41-4c83-9c59-4233690febf1] Going to try to terminate instance {{(pid=124980) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:20:32.959116 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-3101c95d-3bfd-4b34-94fd-f701c371879c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1" status: 204 len: 0 microversion: 2.1 time: 0.414973 Jun 24 10:20:32.959627 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 575/1180] 10.222.0.26 () {58 vars in 1238 bytes} [Fri Jun 24 10:20:32 2022] DELETE /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:20:32.968722 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-58bb0b12-6397-4bcf-93aa-54f8150c67c9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:32.969723 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-58bb0b12-6397-4bcf-93aa-54f8150c67c9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 9c5d21f0-8a41-4c83-9c59-4233690febf1] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:32.976340 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-58bb0b12-6397-4bcf-93aa-54f8150c67c9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:32.976792 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-58bb0b12-6397-4bcf-93aa-54f8150c67c9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:32.977763 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-58bb0b12-6397-4bcf-93aa-54f8150c67c9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:32.978371 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-58bb0b12-6397-4bcf-93aa-54f8150c67c9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:33.120908 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-58bb0b12-6397-4bcf-93aa-54f8150c67c9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:33.129145 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-58bb0b12-6397-4bcf-93aa-54f8150c67c9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1" status: 200 len: 1578 microversion: 2.1 time: 0.164852 Jun 24 10:20:33.129716 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 606/1181] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:32 2022] GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:34.147693 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-24971e90-98ab-40fe-895b-9af816987d54 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:34.148430 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-24971e90-98ab-40fe-895b-9af816987d54 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 9c5d21f0-8a41-4c83-9c59-4233690febf1] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:34.155080 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-24971e90-98ab-40fe-895b-9af816987d54 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:34.155529 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-24971e90-98ab-40fe-895b-9af816987d54 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:34.156326 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-24971e90-98ab-40fe-895b-9af816987d54 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:34.156762 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-24971e90-98ab-40fe-895b-9af816987d54 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:34.354003 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-24971e90-98ab-40fe-895b-9af816987d54 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:34.361651 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-24971e90-98ab-40fe-895b-9af816987d54 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1" status: 200 len: 1578 microversion: 2.1 time: 0.218304 Jun 24 10:20:34.362732 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 576/1182] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:34 2022] GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1 => generated 1578 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:35.322819 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [req-98d1eb87-a858-4fbd-ae99-6e5711385b18 req-de874c33-6e93-4fcd-9a9b-ada8feb1a28b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c5d21f0-8a41-4c83-9c59-4233690febf1", "name": "network-vif-deleted", "tag": "8bdbb20d-d945-4771-9616-869e1f53ad73"}]} {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:20:35.331795 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-98d1eb87-a858-4fbd-ae99-6e5711385b18 req-de874c33-6e93-4fcd-9a9b-ada8feb1a28b service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:35.332282 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [req-98d1eb87-a858-4fbd-ae99-6e5711385b18 req-de874c33-6e93-4fcd-9a9b-ada8feb1a28b service nova] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:35.343941 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.compute.server_external_events [req-98d1eb87-a858-4fbd-ae99-6e5711385b18 req-de874c33-6e93-4fcd-9a9b-ada8feb1a28b service nova] Creating event network-vif-deleted:8bdbb20d-d945-4771-9616-869e1f53ad73 for instance 9c5d21f0-8a41-4c83-9c59-4233690febf1 on hv-cinder-84327 Jun 24 10:20:35.349114 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [req-98d1eb87-a858-4fbd-ae99-6e5711385b18 req-de874c33-6e93-4fcd-9a9b-ada8feb1a28b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029973 Jun 24 10:20:35.352719 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 607/1183] 10.222.0.26 () {64 vars in 1317 bytes} [Fri Jun 24 10:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:20:35.380635 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-41e29941-8ca6-41cf-8a63-d5a55a21807c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:35.381410 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-41e29941-8ca6-41cf-8a63-d5a55a21807c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 9c5d21f0-8a41-4c83-9c59-4233690febf1] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:35.387797 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-41e29941-8ca6-41cf-8a63-d5a55a21807c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:35.388279 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-41e29941-8ca6-41cf-8a63-d5a55a21807c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:35.389036 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-41e29941-8ca6-41cf-8a63-d5a55a21807c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:35.389466 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-41e29941-8ca6-41cf-8a63-d5a55a21807c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:35.455293 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.policy [None req-41e29941-8ca6-41cf-8a63-d5a55a21807c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124980) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:35.463869 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-41e29941-8ca6-41cf-8a63-d5a55a21807c tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1" status: 200 len: 1392 microversion: 2.1 time: 0.087614 Jun 24 10:20:35.464459 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 577/1184] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:35 2022] GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1 => generated 1392 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:36.481228 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-fec2e26a-e714-4e35-bee4-afaf91bdb8e7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:36.482067 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-fec2e26a-e714-4e35-bee4-afaf91bdb8e7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 9c5d21f0-8a41-4c83-9c59-4233690febf1] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:36.488897 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fec2e26a-e714-4e35-bee4-afaf91bdb8e7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:36.489380 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fec2e26a-e714-4e35-bee4-afaf91bdb8e7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:36.490254 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fec2e26a-e714-4e35-bee4-afaf91bdb8e7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:36.490924 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fec2e26a-e714-4e35-bee4-afaf91bdb8e7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:36.522994 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fec2e26a-e714-4e35-bee4-afaf91bdb8e7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:36.523441 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-fec2e26a-e714-4e35-bee4-afaf91bdb8e7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:36.523895 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.objects.instance [None req-fec2e26a-e714-4e35-bee4-afaf91bdb8e7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lazy-loading 'fault' on Instance uuid 9c5d21f0-8a41-4c83-9c59-4233690febf1 {{(pid=124979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:20:36.566603 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.policy [None req-fec2e26a-e714-4e35-bee4-afaf91bdb8e7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40db8a50905141ffb83d84d83065952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea76e34ae2a4569851abd4e596b5e77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124979) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:36.574735 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-fec2e26a-e714-4e35-bee4-afaf91bdb8e7 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1" status: 200 len: 1231 microversion: 2.1 time: 0.097734 Jun 24 10:20:36.575297 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 608/1185] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:36 2022] GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1 => generated 1231 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:37.592533 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-f313967d-8fcf-421c-814b-863837fbe415 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:37.593180 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-f313967d-8fcf-421c-814b-863837fbe415 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 9c5d21f0-8a41-4c83-9c59-4233690febf1] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:37.600188 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f313967d-8fcf-421c-814b-863837fbe415 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:37.600643 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f313967d-8fcf-421c-814b-863837fbe415 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:37.601418 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f313967d-8fcf-421c-814b-863837fbe415 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:37.601845 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f313967d-8fcf-421c-814b-863837fbe415 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:37.615808 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.wsgi [None req-f313967d-8fcf-421c-814b-863837fbe415 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] HTTP exception thrown: Instance 9c5d21f0-8a41-4c83-9c59-4233690febf1 could not be found. Jun 24 10:20:37.617516 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-f313967d-8fcf-421c-814b-863837fbe415 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Request method failure captured: Jun 24 10:20:37.617516 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: request: GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1 HTTP/1.1 Jun 24 10:20:37.617516 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept: application/json Jun 24 10:20:37.617516 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept-Encoding: identity Jun 24 10:20:37.617516 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Connection: close Jun 24 10:20:37.617516 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Length: 0 Jun 24 10:20:37.617516 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Type: application/json Jun 24 10:20:37.617516 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Host: 10.222.0.26 Jun 24 10:20:37.617516 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Openstack-System-Scope: None Jun 24 10:20:37.617516 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: User-Agent: python-urllib3/1.26.9 Jun 24 10:20:37.617516 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Auth-Token: gAAAAABitY4-mZzxoWEv_LI9TYi1AzdmQ7G-PR0BrmJqvZvKXoIalr0MomVzZ-fihaxe0TZ7uOZcJ55kBNa-DKOp71AdPyugpp77X6EbAX2vKGVnsRuWX9n53vPkBOoNKbXKbXWr9T75Md29KBwnYNhIGaO9sd3edR5iuLrDrQRn8ojNSsEJCmU Jun 24 10:20:37.617516 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Id: None Jun 24 10:20:37.617516 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Name: None Jun 24 10:20:37.617516 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Identity-Status: Confirmed Jun 24 10:20:37.617516 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Is-Admin-Project: True Jun 24 10:20:37.617516 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Id: default Jun 24 10:20:37.617516 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Name: Default Jun 24 10:20:37.617516 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Id: 2ea76e34ae2a4569851abd4e596b5e77 Jun 24 10:20:37.617516 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Name: tempest-TestVolumeBootPattern-1176966912 Jun 24 10:20:37.617516 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Role: reader,member Jun 24 10:20:37.617516 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Roles: reader,member Jun 24 10:20:37.619320 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2ea76e34ae2a4569851abd4e596b5e77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2ea76e34ae2a4569851abd4e596b5e77", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2ea76e34ae2a4569851abd4e596b5e77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2ea76e34ae2a4569851abd4e596b5e77"}]}] Jun 24 10:20:37.619320 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant: tempest-TestVolumeBootPattern-1176966912 Jun 24 10:20:37.619320 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Id: 2ea76e34ae2a4569851abd4e596b5e77 Jun 24 10:20:37.619320 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Name: tempest-TestVolumeBootPattern-1176966912 Jun 24 10:20:37.619320 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User: tempest-TestVolumeBootPattern-1176966912-project Jun 24 10:20:37.619320 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Id: default Jun 24 10:20:37.619320 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Name: Default Jun 24 10:20:37.619320 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Id: 40db8a50905141ffb83d84d83065952b Jun 24 10:20:37.619320 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Name: tempest-TestVolumeBootPattern-1176966912-project Jun 24 10:20:37.619320 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: method: > Jun 24 10:20:37.619320 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: exception: Instance 9c5d21f0-8a41-4c83-9c59-4233690febf1 could not be found. Jun 24 10:20:37.619320 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: action_args: {'id': '9c5d21f0-8a41-4c83-9c59-4233690febf1'} Jun 24 10:20:37.620622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:20:37.620622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:20:37.620622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:20:37.620622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:20:37.620622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:20:37.620622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:20:37.620622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:20:37.620622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:20:37.620622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:20:37.620622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:20:37.620622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c5d21f0-8a41-4c83-9c59-4233690febf1 could not be found. Jun 24 10:20:37.620622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:20:37.620622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:20:37.620622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:20:37.620622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:20:37.620622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:20:37.620622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:20:37.620622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:20:37.620622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:20:37.620622 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:20:37.622439 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:20:37.622439 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:20:37.622439 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:20:37.622439 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:20:37.622439 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:20:37.622439 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:20:37.622439 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:20:37.622439 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c5d21f0-8a41-4c83-9c59-4233690febf1 could not be found. Jun 24 10:20:37.622439 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:20:37.622439 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:20:37.622439 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:20:37.622439 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:20:37.622439 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:20:37.622439 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:20:37.622439 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:20:37.622439 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:20:37.622439 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c5d21f0-8a41-4c83-9c59-4233690febf1 could not be found. Jun 24 10:20:37.622439 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:20:37.624001 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-f313967d-8fcf-421c-814b-863837fbe415 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Returning 404 to user: Instance 9c5d21f0-8a41-4c83-9c59-4233690febf1 could not be found. {{(pid=124980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:20:37.624001 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-f313967d-8fcf-421c-814b-863837fbe415 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1" status: 404 len: 111 microversion: 2.1 time: 0.030365 Jun 24 10:20:37.624001 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 578/1186] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:37 2022] GET /compute/v2.1/servers/9c5d21f0-8a41-4c83-9c59-4233690febf1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:20:38.172992 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-6d24cda4-8a1d-4117-8f7e-a5abe73e49a9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:38.173508 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.compute.api [None req-6d24cda4-8a1d-4117-8f7e-a5abe73e49a9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 40064e94-9dd9-4008-a3f1-2216553f98ea] Fetching instance by UUID {{(pid=124979) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:38.180391 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6d24cda4-8a1d-4117-8f7e-a5abe73e49a9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:38.180842 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6d24cda4-8a1d-4117-8f7e-a5abe73e49a9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:38.181606 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6d24cda4-8a1d-4117-8f7e-a5abe73e49a9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:38.182042 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG oslo_concurrency.lockutils [None req-6d24cda4-8a1d-4117-8f7e-a5abe73e49a9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:38.196116 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.wsgi [None req-6d24cda4-8a1d-4117-8f7e-a5abe73e49a9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] HTTP exception thrown: Instance 40064e94-9dd9-4008-a3f1-2216553f98ea could not be found. Jun 24 10:20:38.198069 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-6d24cda4-8a1d-4117-8f7e-a5abe73e49a9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Request method failure captured: Jun 24 10:20:38.198069 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: request: DELETE /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea HTTP/1.1 Jun 24 10:20:38.198069 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept: application/json Jun 24 10:20:38.198069 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Accept-Encoding: identity Jun 24 10:20:38.198069 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Connection: close Jun 24 10:20:38.198069 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Length: 0 Jun 24 10:20:38.198069 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Content-Type: application/json Jun 24 10:20:38.198069 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Host: 10.222.0.26 Jun 24 10:20:38.198069 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Openstack-System-Scope: None Jun 24 10:20:38.198069 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: User-Agent: python-urllib3/1.26.9 Jun 24 10:20:38.198069 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Auth-Token: gAAAAABitY4-mZzxoWEv_LI9TYi1AzdmQ7G-PR0BrmJqvZvKXoIalr0MomVzZ-fihaxe0TZ7uOZcJ55kBNa-DKOp71AdPyugpp77X6EbAX2vKGVnsRuWX9n53vPkBOoNKbXKbXWr9T75Md29KBwnYNhIGaO9sd3edR5iuLrDrQRn8ojNSsEJCmU Jun 24 10:20:38.198069 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Id: None Jun 24 10:20:38.198069 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Domain-Name: None Jun 24 10:20:38.198069 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Identity-Status: Confirmed Jun 24 10:20:38.198069 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Is-Admin-Project: True Jun 24 10:20:38.198069 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Id: default Jun 24 10:20:38.198069 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Domain-Name: Default Jun 24 10:20:38.198069 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Id: 2ea76e34ae2a4569851abd4e596b5e77 Jun 24 10:20:38.198069 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Project-Name: tempest-TestVolumeBootPattern-1176966912 Jun 24 10:20:38.198069 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Role: reader,member Jun 24 10:20:38.198069 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Roles: reader,member Jun 24 10:20:38.199858 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2ea76e34ae2a4569851abd4e596b5e77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2ea76e34ae2a4569851abd4e596b5e77", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2ea76e34ae2a4569851abd4e596b5e77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2ea76e34ae2a4569851abd4e596b5e77"}]}] Jun 24 10:20:38.199858 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant: tempest-TestVolumeBootPattern-1176966912 Jun 24 10:20:38.199858 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Id: 2ea76e34ae2a4569851abd4e596b5e77 Jun 24 10:20:38.199858 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-Tenant-Name: tempest-TestVolumeBootPattern-1176966912 Jun 24 10:20:38.199858 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User: tempest-TestVolumeBootPattern-1176966912-project Jun 24 10:20:38.199858 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Id: default Jun 24 10:20:38.199858 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Domain-Name: Default Jun 24 10:20:38.199858 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Id: 40db8a50905141ffb83d84d83065952b Jun 24 10:20:38.199858 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: X-User-Name: tempest-TestVolumeBootPattern-1176966912-project Jun 24 10:20:38.199858 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: method: > Jun 24 10:20:38.199858 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: exception: Instance 40064e94-9dd9-4008-a3f1-2216553f98ea could not be found. Jun 24 10:20:38.199858 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: action_args: {'id': '40064e94-9dd9-4008-a3f1-2216553f98ea'} Jun 24 10:20:38.200875 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:20:38.200875 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:20:38.200875 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:20:38.200875 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:20:38.200875 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:20:38.200875 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:20:38.200875 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:20:38.200875 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:20:38.200875 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:20:38.200875 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:20:38.200875 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40064e94-9dd9-4008-a3f1-2216553f98ea could not be found. Jun 24 10:20:38.200875 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:20:38.200875 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:20:38.200875 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:20:38.200875 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:20:38.200875 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:20:38.200875 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:20:38.200875 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:20:38.200875 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:20:38.200875 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:20:38.202614 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:20:38.202614 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 10:20:38.202614 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 10:20:38.202614 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 10:20:38.202614 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 10:20:38.202614 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:20:38.202614 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:20:38.202614 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:20:38.202614 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:20:38.202614 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40064e94-9dd9-4008-a3f1-2216553f98ea could not be found. Jun 24 10:20:38.202614 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:20:38.202614 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:20:38.202614 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:20:38.202614 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:20:38.202614 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:20:38.202614 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:20:38.202614 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:20:38.202614 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:20:38.202614 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40064e94-9dd9-4008-a3f1-2216553f98ea could not be found. Jun 24 10:20:38.202614 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: ERROR nova.api.openstack.wsgi Jun 24 10:20:38.204342 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-6d24cda4-8a1d-4117-8f7e-a5abe73e49a9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Returning 404 to user: Instance 40064e94-9dd9-4008-a3f1-2216553f98ea could not be found. {{(pid=124979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:20:38.204342 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-6d24cda4-8a1d-4117-8f7e-a5abe73e49a9 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "DELETE /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea" status: 404 len: 111 microversion: 2.1 time: 0.031170 Jun 24 10:20:38.204342 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 609/1187] 10.222.0.26 () {58 vars in 1238 bytes} [Fri Jun 24 10:20:38 2022] DELETE /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:20:38.209379 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-f8f5edc3-64c4-40af-8f2c-6ee2b3867bbb tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '>' {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:38.209996 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.compute.api [None req-f8f5edc3-64c4-40af-8f2c-6ee2b3867bbb tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] [instance: 40064e94-9dd9-4008-a3f1-2216553f98ea] Fetching instance by UUID {{(pid=124980) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:38.216587 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f8f5edc3-64c4-40af-8f2c-6ee2b3867bbb tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:38.217044 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f8f5edc3-64c4-40af-8f2c-6ee2b3867bbb tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:38.217810 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f8f5edc3-64c4-40af-8f2c-6ee2b3867bbb tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:38.218313 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG oslo_concurrency.lockutils [None req-f8f5edc3-64c4-40af-8f2c-6ee2b3867bbb tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Lock "fe31d9cf-df6b-4323-b574-c2625778abf9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124980) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:38.231830 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.wsgi [None req-f8f5edc3-64c4-40af-8f2c-6ee2b3867bbb tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] HTTP exception thrown: Instance 40064e94-9dd9-4008-a3f1-2216553f98ea could not be found. Jun 24 10:20:38.233701 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-f8f5edc3-64c4-40af-8f2c-6ee2b3867bbb tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Request method failure captured: Jun 24 10:20:38.233701 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: request: GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea HTTP/1.1 Jun 24 10:20:38.233701 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept: application/json Jun 24 10:20:38.233701 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Accept-Encoding: identity Jun 24 10:20:38.233701 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Connection: close Jun 24 10:20:38.233701 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Length: 0 Jun 24 10:20:38.233701 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Content-Type: application/json Jun 24 10:20:38.233701 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Host: 10.222.0.26 Jun 24 10:20:38.233701 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Openstack-System-Scope: None Jun 24 10:20:38.233701 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: User-Agent: python-urllib3/1.26.9 Jun 24 10:20:38.233701 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Auth-Token: gAAAAABitY4-mZzxoWEv_LI9TYi1AzdmQ7G-PR0BrmJqvZvKXoIalr0MomVzZ-fihaxe0TZ7uOZcJ55kBNa-DKOp71AdPyugpp77X6EbAX2vKGVnsRuWX9n53vPkBOoNKbXKbXWr9T75Md29KBwnYNhIGaO9sd3edR5iuLrDrQRn8ojNSsEJCmU Jun 24 10:20:38.233701 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Id: None Jun 24 10:20:38.233701 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Domain-Name: None Jun 24 10:20:38.233701 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Identity-Status: Confirmed Jun 24 10:20:38.233701 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Is-Admin-Project: True Jun 24 10:20:38.233701 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Id: default Jun 24 10:20:38.233701 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Domain-Name: Default Jun 24 10:20:38.233701 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Id: 2ea76e34ae2a4569851abd4e596b5e77 Jun 24 10:20:38.233701 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Project-Name: tempest-TestVolumeBootPattern-1176966912 Jun 24 10:20:38.233701 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Role: reader,member Jun 24 10:20:38.233701 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Roles: reader,member Jun 24 10:20:38.235546 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2ea76e34ae2a4569851abd4e596b5e77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2ea76e34ae2a4569851abd4e596b5e77", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2ea76e34ae2a4569851abd4e596b5e77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2ea76e34ae2a4569851abd4e596b5e77"}]}] Jun 24 10:20:38.235546 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant: tempest-TestVolumeBootPattern-1176966912 Jun 24 10:20:38.235546 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Id: 2ea76e34ae2a4569851abd4e596b5e77 Jun 24 10:20:38.235546 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-Tenant-Name: tempest-TestVolumeBootPattern-1176966912 Jun 24 10:20:38.235546 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User: tempest-TestVolumeBootPattern-1176966912-project Jun 24 10:20:38.235546 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Id: default Jun 24 10:20:38.235546 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Domain-Name: Default Jun 24 10:20:38.235546 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Id: 40db8a50905141ffb83d84d83065952b Jun 24 10:20:38.235546 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: X-User-Name: tempest-TestVolumeBootPattern-1176966912-project Jun 24 10:20:38.235546 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: method: > Jun 24 10:20:38.235546 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: exception: Instance 40064e94-9dd9-4008-a3f1-2216553f98ea could not be found. Jun 24 10:20:38.235546 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: action_args: {'id': '40064e94-9dd9-4008-a3f1-2216553f98ea'} Jun 24 10:20:38.236451 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: {{(pid=124980) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:20:38.236451 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:20:38.236451 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:20:38.236451 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:20:38.236451 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:20:38.236451 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:20:38.236451 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:20:38.236451 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:20:38.236451 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:20:38.236451 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:20:38.236451 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40064e94-9dd9-4008-a3f1-2216553f98ea could not be found. Jun 24 10:20:38.236451 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:20:38.236451 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:20:38.236451 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:20:38.236451 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:20:38.236451 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:20:38.236451 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:20:38.236451 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:20:38.236451 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:20:38.236451 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:20:38.237911 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:20:38.237911 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:20:38.237911 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:20:38.237911 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:20:38.237911 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:20:38.237911 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:20:38.237911 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:20:38.237911 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40064e94-9dd9-4008-a3f1-2216553f98ea could not be found. Jun 24 10:20:38.237911 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:20:38.237911 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:20:38.237911 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:20:38.237911 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:20:38.237911 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:20:38.237911 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:20:38.237911 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:20:38.237911 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:20:38.237911 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40064e94-9dd9-4008-a3f1-2216553f98ea could not be found. Jun 24 10:20:38.237911 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: ERROR nova.api.openstack.wsgi Jun 24 10:20:38.239145 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: DEBUG nova.api.openstack.wsgi [None req-f8f5edc3-64c4-40af-8f2c-6ee2b3867bbb tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Returning 404 to user: Instance 40064e94-9dd9-4008-a3f1-2216553f98ea could not be found. {{(pid=124980) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:20:38.239145 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO nova.api.openstack.requestlog [None req-f8f5edc3-64c4-40af-8f2c-6ee2b3867bbb tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea" status: 404 len: 111 microversion: 2.1 time: 0.030150 Jun 24 10:20:38.239145 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: [pid: 124980|app: 0|req: 579/1188] 10.222.0.26 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:38 2022] GET /compute/v2.1/servers/40064e94-9dd9-4008-a3f1-2216553f98ea => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:20:39.768527 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: DEBUG nova.api.openstack.wsgi [None req-f4e51776-a195-4419-aceb-1a71c60c01b1 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] Calling method '.version_select at 0x7f0309ce03a0>' {{(pid=124979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:39.850432 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO nova.api.openstack.requestlog [None req-f4e51776-a195-4419-aceb-1a71c60c01b1 tempest-TestVolumeBootPattern-1176966912 tempest-TestVolumeBootPattern-1176966912-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1794596080" status: 202 len: 0 microversion: 2.1 time: 0.085806 Jun 24 10:20:39.851019 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: [pid: 124979|app: 0|req: 610/1189] 10.222.0.26 () {58 vars in 1262 bytes} [Fri Jun 24 10:20:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1794596080 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:21:14.660596 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:21:14.661333 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Fri Jun 24 10:21:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:21:16.653128 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:21:16.653677 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Fri Jun 24 10:21:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:22:48.158116 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:22:48.158819 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Fri Jun 24 10:22:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:23:31.122179 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:23:31.122933 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Fri Jun 24 10:23:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:24:34.670441 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:24:34.671106 dv-cinder-843277-6-iscsi devstack@n-api.service[124980]: Fri Jun 24 10:24:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:24:36.661564 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:24:36.662098 dv-cinder-843277-6-iscsi devstack@n-api.service[124979]: Fri Jun 24 10:24:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!